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SUMMARY 

An investigation was undertaken which compared images taken from 
the Skylab Earth Resources Experimental Package (EREP) system (S190A 
and S190B) with the Earth Resources Technology Satellite (ERTS-1) 
multi spectral scanner (MSS). The study compared the effectiveness of 
each system for identifying and delineating natural vegetation com- 
plexes in the Colorado Plateau and agricultural croplands in the 
Northern Great Valley of California. 

Images from each system taken over each test area at comparable 
dates were selected and photo interpretation tests were conducted using 
the prepared materials and a team of 40 photo interpreters. Selected 
image features on each image type were identified by each interpreter 
according to a prescribed set of instructions during formal test 
periods. In addition, experienced staff interpreters compared images 
from the EREP and ERTS systems, making subjective evaluations of 
questions not addressed by the formal testing. 

More than 40,000 individual test responses were generated from 
these tests, thus providing a solid statistical base for assessing the 
relative interpretability of each image type. The test responses were 
scored using ground data obtained by on-site visits and from large 
scale aircraft photographs where features were easily identifiable. 
Statistical analyses were performed using the test results, and conclu- 
sions were reached regarding the relative utility of each system. 
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The eight image types used were EREP S190A color and color infrared, 
and also black-and-white images in the red and near infrared spectral 
regions; S190B high resolution color; and ERTS color composite (color 
infrared simulation — bands 4, 5 and 7) and MSS black-and-white bands 5 
and 7. ERTS and EREP data were acquired as follows: 


Test Area 

System 

Date (1973) 

Northern Great Valley 

ERTS 

May 28, September 13 

of California 

EREP 

June 3, September 12 

Colorado Plateau 

ERTS 

August 16 


EREP 

August 3 and 8 


The following statements summarize the results of this study: 

* For identification of agricultural crops in the northern 
Great Valley of California at the late summer seasonal 
state, the ERTS color composite (bands 4, 5, 7) and 
EREP S190A color IR image are judged best of the eight 
image types tested. 

* For crop identification at the late spring seasonal state 
in the Northern Great Valley Test Area of California, the 
EREP S190A color and color IR images are judged best of 
the eight image types tested. Comparable accuracy for 
overall crop identification was obtained at the two dates. 
A particular film type would be specified only if high 
identification accuracy were required for a particular 
crop type. 

* Multidate additive color enhancement is valuable for 
assessing year-to-year change in area of rice culture. 

* For identification of natural vegetation types in the 
Colorado Plateau Test Area, the EREP S190A color IR 
image was judged better than all other image types tested. 
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• For overall identification of both natural and agricultural 
vegetation complexes, the eight image types rank as follows 
(from best to worst): 

EREP S190A Color IR 
ERTS Color Composite ]_/ 

EREP S190B Color 1/ 

EREP S190A Color 
EREP S190A B/W IR 
ERTS Band 7 
EREP S190A B/W Red 
ERTS Band 5 


1/ These image types rank equally high for some purposes. 

• Interpretation results for stereoscopic interpretation by 
skilled interpreters who understand the relationship between 
vegetation types and landform/topography are markedly better 
than results obtained by monoscopic interpretation. 

• Minimum detectable field size is smallest for images of 
highest resolution (e.g., EREP S190B and S190A color) and 
greatest for images of poorest resolution (ERTS). 

• Delineation of rice-growing areas was accomplished with 
90.7% accuracy using an early summer ERTS color composite and 
82.1 % accuracy with early summer EREP S190A color IR 
imagery. 

• EREP S190A color IR and S190B color, in that order, are 
judged to be best for mapping of natural vegetation types 
in the Colorado Plateau Test Area. 

• Color infrared imagery was the most useful for evaluating 
crop vigor and plant stress. 

• ERTS and EREP S190A systems are considered adequate for 
regional crop survey studies (such as regional drought 
assessment from season to season), but the EREP S190B 
system is required as a data source for making most crop 
management decisions. 

• EREP S190B imagery is also required for assessing the 
extent of lodging in rice fields on a field by field basis. 
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• The frequency of coverage is difficult to specify for any 
system without a thorough study of prevailing weather 
conditions and a study of the occurrence of critical crop 
events. Delays of more than a few days in receipt of data 
from satellite systems can cause severe problems in their 
use for crop management and marketing decisions. For 
regional surveys, on the other hand, delays of up to several 
weeks can be tolerated. 
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I. INTRODUCTION 

Photo interpretation of earth resources requires a series of 
complex judgements by the image analyst. The difficulty with which 
these judgements are made and the frequency and importance of the 
associated errors made in analyzing remote sensing images are a function 
of many factors. This report considers only those image factors related 
to spatial resolution, the effects of various black-and-white and color 
images, and the temporal considerations of sequential coverage. 

While an all-inclusive test could be designed to study the effects 
of various seasonal photo inputs, scale factors and human interpretation 
problems, only a limited number of images were available from the Skylab 
overpasses, restricting the coverage that could be used in this study 
and therefore the questions that could be addressed. However, it is be- 
lieved that the questions dealt With in this study were clearly among the 
most important ones that would need to be dealt with, even in a more 
comprehensive test. 

Several factors interact to determine the nature of the images 
obtained from Skylab and ERTS. The Skylab EREP system used cameras 
which take photographs by conventional means. Film was returned to 
earth from orbit by the astronauts. ERTS MSS images, on the other hand, 
were obtained by an optical mechanical scanner and the image data were 
telemetered to earth from orbit by digital means. Skylab multispectral 
scanner images were also acquired but were not available for this investiga- 
tion. 
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It was recognized at the outset that certain important differences 
in image characteristics existed between EREP and ERTS and that those 
differences restricted the comparisons that could be made. However, for 
conventional visual image analysis questions, the image differences 
(inherent in scanner imagery vs. photography) would not restrict the 
making of certain judgements regarding spatial resolution and multiband 
interpretation. 

The following problem statement was made at the beginning of the 
study to guide the investigation. 

A. PROBLEM STATEMENT 

Evaluate and compare the usefulness of EREP and ERTS remote 
sensing systems for identification and evaluation of vegetation 
resources by testing the ability of photo interpreters to make the 
desired interpretations on selected types of EREP and ERTS imagery. 

1 . Agricultural Test Area (Northern Great Valley of California) 

a. How effective is each system for delineating and 
identifying land use in the Northern Great Valley 
Test Area? 

Land Use Categories : 

Agriculture 
Dryland pasture 
Woodlot 
Urban 

Unused land 

Water bodies and drainage 

b. Which system provides maximum accuracy in crop 
identification? 
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Agricultural Crop Categories : 

Rice 

Orchard 

Alfalfa 

Fallow 

Dryland pasture 

Other agricultural crops 

c. Which system provides the best means to evaluate 
crop vigor and determine the effects of yield 
limiting agents? 


2. Natural Vegetation Test Area (Colorado Plateau) 

a. How effective is each system for identifying natural 
vegetation units in the Colorado Plateau Test Area? 


Vegetation Categories : 

Pinyon-juniper woodland 
Ponderosa pine forest 
Sedge (wet) meadow 
Aspen forest 
Spruce-fir forest 
Other vegetational types 

b. Will stereoscopic viewing increase the information 
derivable from S190A imagery over monocular viewing 
for the above question? 
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Systems and Image Types Evaluated : 


System 

Image Type 

Spectral Band, tim 

Nominal Resolution, Ft.-^ 

ERTS MSS 

Band 5 

0.6 - 0.7 

200 


Band 7 

0.8 - 1.1 

200 


Color Composite 

0.5 - 1.1 

200 

EREP S190A 

B/W Red 

0.6 - 0.7 

91 


B/W IR 

0.8 - 0.9 

223 


Color 

0.4 - 0.7 

78 


Color IR 

0.5 - 0.88 

187 

EREP S190B 

Color 

0.4 - 0.7 

50 


T/ ERTS pixel - 200’ x 200'; EREP estimates from NASA Skylab data user's 
documents. 


B. APPROACH 

Selected image examples which had been acquired nearly concurrently 
from EREP (S190A and S190B) and ERTS (MSS) overpasses were used to perform 
a series of photo interpretation tests to determine the usefulness of each 
system for the questions defined above. Further nontesting subjective 
analysis was performed by personnel who have extensive experience in this 
and related studies to make judgements not conveniently accomplished with 
quantitative tests. 

The results of these quantitative and qualitative tests led to a 
series of conclusions regarding the adequacy of the images tested with 
respect to a) spatial resolution and b) tonal and color quality for 
identification and delineation of the natural vegetation and agricultural 
categories. In addition, determinations were made as to the interpretability 
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of crops on various kinds of ERTS and EREP imagery taken at two 
different seasonal states, viz., late spring and late sunnier. The 
results and conclusions from these tests are contained in later 
sections of this report. 

C. SCOPE OF STUDY 

Because of limitations of availability of suitable EREP and 
ERTS coverage, PI testing was performed on one natural vegetation 
area at one seasonal state and one agricultural area at two seasonal 
states. Additional factors were considered for both sites by a non- 
testing subjective analysis using direct comparisons of EREP and ERTS 
images. For those features where positive identification was avail- 
able by ground observation or by photo interpretation of large scale 
aerial photos, a ground data map was prepared and used in selecting 
test fields, in scoring the PI tests, and for making subjective 
evaluations. 

D. TEST SITE DESCRIPTION 

The geographic areas selected for interpretation testing are 
those in which the investigators currently have active ERTS-1 and 
EREP experiments. The Northern Great Valley of California (Figure 1) 
is a region of varied agricultural practices. Current ERTS and EREP 
studies focus on interpretation of the rice crop in this area. Since 
the region contains a variety of other agricultural crops, it is also 
an ideal location for assessing the photo interpretability of several 
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crop types as well as general land use patterns. The Colorado 
Plateau Test Area (Figure 2) is a region of wide elevation ranges 
and a correspondingly wide range in vegetation types. 

1 . Northern Great Valley Test Area 

The Northern Great Valley Test Area is located in the 
northern half of the Central Valley of California. The climate 
of the area is Mediterranean to semi -conti nental . The winters 
are cool to cold with temperature ranges from 25° to 70° F. 

Most of the precipitation occurs in the winter and the rainy 
season normally extends from November to March. The summers are 
warm and dry; temperatures range from 60° to over 100° F. with 
some precipitation falling from sporadic thundershowers. The 
soils consist primarily of alluvial loamy sands. Over the entire 
area the crop type diversity is great, including rice, tomatoes, 
alfalfa, sugar beets, corn, sorghum, beans, peppers, wheat, 
barley, oats, safflower, orchards, vineyards and pasture. The 
combination of clear arid surrmer weather and the high crop 
diversity creates an excellent study area. 

Within the Test Area, field size is variable. In broad 
level areas of intensive cultivation (especially where rice 
culture predominates), common field sizes are 40, 80 and 160 
acres, and fields of 160 acres are most common. In other areas 
(for example, along irregular river channels), average field 
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Figure 2 . Location map for the Colorado Plateau Test Area (scale 1/2,000,000) 
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size is 30 to 40 acres and ranges from 10 to 80 acres. Field 
shapes generally conform to the township and range subdivision 
used in California. 

Within this Test Area, two test sites were selected, as 
described below: 

Sutter Test Site 

This site is located approximately 20 miles north 
and west of Sacramento, California (Figure 1). The site 
is approximately 100 square nautical miles in size, and 
contains the town of Robbins. The area is flat-lying with 
the only major feature being the Sutter Bypass, a flood 
diversion channel from the Sacramento River. The parent 
material is recent alluvium deposited by the Sacramento 
and Feather Rivers. The soils consist of deep and moderately 
to poorly drained sandy clay loams and are rich and well 
suited for all forms of agriculture. The climate is 
influenced slightly by the delta region. Precipitation 
generally ranges from 20 to 30 inches per year, mostly 
falling during the winter as rain, with scattered thunder- 
showers in the summer. Frosts are common beginning in 
September and continuing through May. 

The major crop types found in the Sutter area are 
rice, tomatoes, safflower, alfalfa, corn, sugar beets, 
orchards and vineyards, wheat, barley, and assorted row 
crops. 
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A brief description of the crop types composing the 
interpretation categories is as follows: 

1. Rice . Fields are diked and flooded in March, 
seeded by airplane in April or May and kept continuously 
flooded almost until harvest in September. There are four 
major varieties, two of which are early varieties and two 
of which are late varieties. This mixture of varieties 
creates a complex mosaic of planting dates and phenological 
development. The crop emerges above the water in about 
four weeks and soon forms a complete cover. Vegetative 
growth takes about two months, during which time the fields 
are top dressed with nitrogen fertilizer by airplane. 
Heading and the onset of maturity occur at about 90 to 120 
days after planting, depending on variety. The rice crop 
is harvested by combines when the grain has dried to 20% 
moisture content. Neither weeds nor diseases present a 
serious problem. 

2, Alfa! fa . The season starts around March and 
runs until late October. Generally, five mowings are made 
in a season. After each mowing, the cut alfalfa is laid 
in rows for drying (a week to ten days) before baling. 
After baling, the crop is flooded and the cycle begins 
again. The result is a crop which fluctuates from 10-15% 
cover to 100% cover four or five times a year. 
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3. Orchards and vineyards . These are perennial 
woody crops of many types including walnuts, peaches, 
prunes, almonds, pears, apricots, plums and grapes. On 
large scale aerial photos these areas are distinctive by 
their consistent cover and pattern. 

4. Other crop types . These crops include tomatoes, 
cereal grains, safflower, corn, sugar beets, beans, melons, 
bell peppers, onions and potatoes. The crop phenologies 
are dependent on the characteristics of each crop type. 

While it usually would be desirable to differentiate these 
widely varying crops from each other, in the present tests 
it was considered to be both necessary and sufficient to 
combine them into a single category and thus to determine 
whether this group of crops was likely to be confused with 
the primary crop types being tested. 

In addition to the intensive types of agriculture, 
there are also present more extensive forms such as irrigated 
and non-irrigated pasture. These areas support cattle and 
sheep for the production of milk, meat, wool and hides. 

The appearance of irrigated pastures is dependent on the 
irrigation cycles and the type of forage crop present. The 
development of non-irrigated rangelands is tied to the annual 
weather patterns. 
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Marysville Test Site 

The Marysville Test Site is located on the east side 
of the Sacramento Valley about five miles north and east 
of Marys vi 1 le-Yuba City. Like the Sutter Test Site, this 
site also contains a 100 square nautical mile block. This 
unit is located a little higher up on the alluvial terrace 
and hence the soil types consist of coarser sandy loams 
than are found in the Sutter Test Site. Most of these 
soils are moderately to well drained and are excellent 
agricultural soils. The climate is slightly more extreme 
than in the Sutter area due to the more continental location. 
Rainfall is a little higher and temperature fluctuations 
are greater. 

The major crop types in the Marysville Test Site are 
rice, orchards, and extensive dryland pasture, with some 
alfalfa occurring in the southeastern portion of the block. 
Photo examples of these crop types (except alfalfa) appear 
in Figures 3 and 4. These crop types occupy fairly homo- 
geneous blocks within the test site, corresponding roughly 
to their distance from, and elevation above, the river 
bottom area. The orchards are found in the river bottom, 
occupying the western third of the block. Rice occupies a 
large block of land in the middle of the test site; the 
eastern portion, which merges into the foothills of the 
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Figure 3 . Oblique aerial view (August 28, 1973) showing a portion of the 
Marysville Test Site. Examples of the following crop categories (used in the 
quantitative tests) are annotated above: rice (R), orchard (0), fallow (F) and 
other agricultural crops (X). Two different stages of growth are exhibited by 

the rice fields. Those in the center (light green) are maturing and the foliage 

has begun to dry out. The dark green fields in the foreground have not yet 

begun to mature and still have green foliage. Note the incidence of lodging 

(patches of the fields have fallen over) in both groups of rice fields. 



Fig u re 4. Oblique aerial view (September 13, 1973) of a portion of the 
Marysville Test Site showing representati ve examples of some of the crop 
categories used in the quantitative tests: rice (R). dryland pasture (6), and 
fallow (F). The rice fields in this scene are also at two stages of maturity, 
as described in Figure 3. Note how the dikes in the rice fields (which permit 
uniform flooding) are much more prominent in the fields of advancing maturity 
(light green) than in those which are not yet maturing (dark green). 
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Sierra Nevada Mountains, contains the extensive dryland 
pastures of the natural rangeland. Crop phenologies are 
essentially the same as in the Sutter Test Site. 

Colorado Plateau Test Area 

This test area, located in southwestern Colorado, intersects 
an almost ideal transect of natural vegetation from sagebrush 
steppe through spruce-fir and alpine forest conditions. The approxi- 
mate center of the test area is located at latitude SS^OO' north 
and longitude 108°20' west. The approximate dimensions of the test 
area are 20 by 60 nautical miles. The area extends from the 
vicinity of Montrose, Colorado across the Uncompahgre Plateau, the 
San Miguel River, Disappointment and Dry Creek Valleys to the 
Dolores River near Cortez, Colorado. The test area also includes 
the small agricultural area around Norwood, Colorado. 

The elevations range from high valleys at about 5,900 to 
7,000 feet to mountain ridges and peaks between 9,500 and 10,000 
feet. 

The vegetational transect includes an excellent representa- 
tion of broad, zonal vegetation types which have analogs widely 
represented in western North America. The vegetational zones 
and major types represented are sagebrush, pi nyon- juniper. Rocky Mt. 
oakbrush, ponderosa pine, and spruce-fir, with extensive stands 
of aspen and many mountain meadows interspersed through the spruce- 
fir zone. Photo examples of these types appear in Figures 5 
through 15. In general, the pinyon- juniper zone begins 




Figur e 5 . The vegetation type at lowest 
elevation in the test area is salt desert 
or shadescale ( Atrip! ex confert if ol ia ) . 
This scene is typical of the stature and 
sparse vegetation cover in this zone. 



Figure 6 . View of the sagebrush (A rtemisia 
tridentata ) vegetation type, which typically 
lies between the salt desert and the pinyon- 
juniper types, extending into the latter zone 
as an understory but occurring also as pure 
types or inclusions of sagebrush throughout 
the pinyon-juniper zone and into the 
ponderosa pine zone. 



Figure 7 . A typical stand of pinyon-juniper 
( Juniperus osteosperma-Pinus ed ulis ) . In 
some areas this type includes a broadleafed 
deciduous shrub associate, oakbrush ( Quercu s 
gambelii ) . In some cases, oakbrush will form 
pure stands within the pinyon-juniper zone 
where moisture levels are more favorable. 
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Figure 8 . A typical stand of ponderosa 
pine ( P1~nus ponderosa ). The understory 
cover in this community may vary from pure 
bunchgrass or sagebrush-grass mixture on 
drier sites to an oakbrush understory on 
moist sites. The prominent undergrowth 
shrubs in this scene are oakbrush. 



Figure 9 • This is a typical ground view of 
the highest elevation forest type in the test 
region, spruce-fir ( Picea engelmanni i - Abies 
lasiocarpa ). This forest type extends to 
timberline in the high mountains. Small lakes, 
ponds, and meadows are quite common, as the 
foreground suggests. 



Figure 10 . A typical stand of aspen ( Populus 
tremuloi des ) . This deciduous woodland is found 
in the spruce-fir zone where it becomes the 
prominent tree species after severe burns. 

It is therefore found in all degrees of mixture 
with spruce and fir as natural succession 
returns to the latter coniferous forest type. 
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Figure 11 . This scene shows a repre- 
sentatively sharp ecotone between the 
brownish saltdesert vegetation on the 
right and the typical pinyon-juniper 
vegetation on the left. In these arid 
and semi-arid regions, vegetation very 
commonly changes with landform and 
geologic types, as in this example. 



Figure 12 . This scene illustrates the 
normal variability in density of the 
pinyon-juniper type as influenced by 
aspect and soil conditions. The valley 
slopes are covered by the pinyon-juniper 
type and the tall trees on the plateau 
in the right background are ponderosa 
pine. Note also the typical extension 
of spruce, oakbrush, and other mountain 
shrub types down the valley bottom. 



Figure 13 . This scene is typical of the 
spruce-fir type as it approaches timber- 
line where barren rock and true alpine 
vegetation determine image characteristics. 
Note especially the meadow type and lake in 
the foreground. Ecotones between forest 
and meadow generally tend to be abrupt, 
as in this scene. 
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Figure 14 . Important vegetation changes 
occur within highly similar landforms at 
higher elevations under sub-humid con- 
ditions. However, these changes usually 
occur in response to more subtle soil 
differences. For example, the foreground 
of this view consists of oakbrush. A 
stand of aspen occurs in the mid-ground 
on the right, and the coniferous forest 
type in the background is ponderosa pine. 
Note the difficulty one would anticipate 
in accurately mapping this vegation 
mosaic at exceedingly small scales. The 
most feasible separation would be merely 
between (a) the oakbrush, with its in- 
clusions of aspen and grassland, and 
(b) the ponderosa pine type. 


Figure 15 . This scene provides a perspec- 
tive of the high elevation zonational 
pattern. This photograph was taken in 
May as the first clones of aspen were 
beginning to leaf out at the lower 
elevations (note the green patch of aspen 
in the foreground). The extensive 
surrounding type is oakbrush in the 
deciduous stage. The gray areas in the 
foreground and the grayish belt just below 
the snow and conifer line in the background 
are stands of aspen. The darker toned 
areas around the lake are ponderosa pine, 
and the near black areas interspered with 
the snow fields are spruce-fir. 
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at about 5,900 to 6,000 feet elevation and the commercial forest 
types at about 7,000 to 8,000 feet. Spruce-fir and aspen are 
common in the 9,000 to 10,000 foot elevations and timberline 
generally is well above 10,000 feet. 

Landforms are particularly evident on the imagery and, for 
the experienced interpreter, the landform-vegetation relationships 
are a particular aid to interpretation. 

This test area is judged to be excellent for the purposes of 
this study because: 

1. Coverage was acquired with all of the ERTS and 

EREP image types being tested. In addition, stereo coverage with 
the EREP S190A color infrared film was also obtained. All are of 
good quality and provide very suitable test material. 

2. A large amount of excellent ground data is available, 
carefully and accurately plotted on 1/250,000 topographic map 
sheets, which permitted accurate identification of both training 
examples and test items throughout the test area. 

3. Broad vegetation zones are well represented in the test 

area. 

4. In addition to the broad vegetation zonation, there are 
extremely intricate patterns of vegetation that, in some areas, 
alternate sharply between both contrasting and noncontrasting 
vegetation types. This provides an excellent opportunity for . 
comparing the power of the image types to resolve the intricate 
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patterns as well as to record an identifiable signature. 

5. There is an extremely diverse land use pattern in the 
area which helps to give the test a particular practical meaning 
and value. Forestry, range, wildlife, agriculture, watershed, 
and recreation are all important land uses, with some mineral 
development in or close to the test area. 

The only imagery-related difficulty encountered was that 
cloud cover somewhat restricted the selection of training examples 
and test items for the image date common to both systems. Never- 
theless, a valid representation of each category was selected from 
the cloud-free image area. 

E. IMAGERY ACQUIRED 

On each of three occasions during the 1973 growing season both 
test areas were imaged by ERTS and EREP systems on nearly the same 
calendar dates. The dates of coverage are summarized as follows: 


Test Site/Seasonal State 


Date of Coveraqe 
EREP 


Northern Great Valley/Late Spring May 28, 1973 June 3, 1973 

Colorado Plateau/ Summer August 16, 1973 August 3 & 8, 1973 

Northern Great Valley/Late Summer September 13, 1973 September 12, 1973 


Table 1 contains a detailed listing of the imagery data, grouped 
by system and test area, which pertain to the images selected for the 
test. 
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TABLE 1 


IMAGES USED FOR ERTS/SKYLAB INTERPRETATION TESTS 
OF AGRICULTURAL AND NATURAL VEGETATION FEATURES 


[mission 

f 

ERTS-1 

1 

SENSOR 

Multi spectral 
Scanner (MSS) 

TEST AREA 

Sacramento 
Valley, CA 

DATE 

May 28, 1973 

IMAGE ID 
1309-18174 

FILM -FILTER/WAVELENGTH INTERVAL, 

! 

( 

Band 5/0. 6-0. 7 

Band 7/0. 8- 1.1 ! 

Color Composite -- 
Bands 4, 5, 7/0. 5-1.1 

Sept. 13, 1973 

1417-18161 

Band 5/0. 6-0. 7 
Band 7/0. 8-1 . 1 
Color Composite — 
Bands 4, 5, 7/0. 5-1. 1 

Colorado 

Plateau 

Aug. 16, 1973 

1389-17195 

Band 5/0. 6-0. 7 
Band 7/0. 8-1 . 1 
Color Composite -- 
Bands 5, 7/0. 6-1.1 

SKYLAB 2 

S190A Multi - 
spectral Photo- 
graphic Camera 
(MPC) 

Sacramento 
Valley, CA 

June 3, 1973 

(roll-frame) 

05-157 

02- 157 
04-157 

03- 157 

Pan-X B/W (S0-022) - BB/0.6-0.7 
IR B/W (EK 2424) - DD/0. 8-0.9 
High Resolution Color (SO-356) - FF/0.4-0.7 
Color IR (EK 2443) - EE/0.5-0.88 

SKYLAB 3 

S190A Multi - 
spectral Photo- 
graphic Camera 
(MPC) 

Colorado 
PI ateau 

August 3, 1973 

23-003 

20- 003 
22-003 

21- 003,004 

Pan-X B/W (S0-022) - BB/0.6-0.7 
IR B/W (EK 2424) - DD/0. 8-0.9 
High Resolution Color (SO-356) - FF/0.4-0.7 
Color IR (EK 2443) - EE/0.5-0.88 

Sacramento 
Valley, CA 

Sept. 12, 1973 

41-140 

38- 140 
40-140 

39- 140 

Pan-X B/W (S0-022) - BB/0.6-0.7 
IR B/W (EK 2424) - DD/0. 8-0.9 
High Resolution Color (SO-356) - FF/0.4-0.7 
Color IR (EK 2443) - EE/0.5-0.88 

S190B Earth 
Terrain Camera 
(ETC) 

Colorado 
PI ateau 

August 8, 1973 

83-309 

High Resolution Color (S0-242) - none/0.4-0.7 

Sacramento 
Valley, CA 

Sept. 12, 1973 

86-320 

High Resolution Color (SO-242) - none/0.4-0.7 



II. QUANTITATIVE TEST OBJECTIVES 

The specific objectives of the quantitative agricultural crop and 
natural vegetation tests, respectively, were as follows: 

A. AGRICULTURAL CROP TESTS 

Test 1 : To determine the relative crop identification accuracy 

achieved with eight types of ERTS and EREP imagery acquired at one 
seasonal state (late summer) for one agricultural area (Northern 
Great Valley of California). 

Test 2 : To determine the relative crop identification accuracy 

achieved with seven types of ERTS and EREP imagery acquired at a 
different seasonal state (late spring) for a portion of the same 
geographic area as selected for Test 1. The value of each season 
(late spring and late summer) for crop identification was also 
assessed. 

Test 3 : To determine the relative accuracy of ERTS color composite 

imagery and EREP S190A IR color photography for stratification 
(delineation) of rice-growing regions within selected portions of 
the Northern Great Valley Test Area (late spring seasonal state). 

B. NATURAL VEGETATION TESTS 

Test 4 : To determine the relative accuracy of identification of 

natural vegetation types achieved with eight types of ERTS and 
EREP imagery acquired at one seasonal state (summer) for one wild- 
land area (Colorado Plateau). 
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Test 5 : To determine the value of stereoscopic viewing for identi- 

fication of natural vegetation types using one type of EREP imagery 
(S190A color IR) . 
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III. QUANTITATIVE TEST PROCEDURES 


A. IMAGE FORMAT 

Preliminary tests were made by EarthSat personnel to establish 
the fact that enlarged positive prints were essentially as inter- 
pretable as positive transparencies. Consequently it was decided 
to administer the interpretation tests using enlarged positive 
prints for the following two reasons: 

1) At least five copies of each image were needed so that 
each section of five interpreters (from a group of 20) 
could interpret the same image at the same time. 

2) Substantial image enlargement was required so that test 
items could be annotated without confusion and interpre- 
tation could proceed without providing each interpreter 
with high-powered magnification capability. 

All formal photo interpretation testing was accomplished 
using the imagery in a positive print form (1/150,000 scale for 
the Northern Great Valley area; 1/500,000 scale for the Colorado 
Plateau area). These prints were made from copy negatives pro- 
duced from the positive transparencies sent to the investigators 
for their ERTS and EREP experiments. Of the black-and-white 
negatives received, only the EREP negatives were of sufficient 
quality to permit direct enlargement (printing) from them. ERTS 
black-and-white negatives were too dense; the positive transparencies 
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were used as the image source instead, with copy negatives made 
as the interim step to obtain positive prints. Examples of each 
of the image types tested appear in Appendix A and should be 
referred to when the interpretation test results derived from 
those particular images are discussed. 

Much of the subjective (non-testing) analysis was undertaken 
with the positive transparencies in order that unnecessary varia- 
tion in photographic characteristics could be avoided. Since the 
subjective analysis was undertaken by only one or two individuals 
at a time, it was feasible to work directly with the positive trans 
parencies under magnifi cation. 

The most critical operational problem in testing was the 
achievement of consistent and uniform color balance among the 
prints compared. For the Northern Great Valley Test Area a set 
of test images of uniform quality was used. Although slight vari- 
ation in image scale did occur for some of the images, this was 
judged not to affect the image signatures of the test categories. 

Comparative color balance on the two members of the stereo 
model used in the natural vegetation test was excellent. Among 
the color prints used in the monocular natural vegetation test, 
the EREP S190A color image was undesirably dark in the entire 
forested area, thus probably detracting from the quality of inter- 
pretation of the forest types with this film-filter combination. 
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The EREP S190A color infrared image had good color balance and 
matched rather well the color balance of the frame used for the 
stereo testing. The EREP S190B color image had good color differ- 
entiation throughout. The ERTS color composite image was reconsti- 
tuted from bands 5 and 7 only. These were the only bands available 
for the required date. It was a rather good quality color product, 
although it did not contain the typical color signatures to which 
most experienced interpreters of ERTS color composites made from 
bands 4, 5 and 7 would have been accustomed. Since the training 
sets were individually identified for each of the film-filter types, 
this was judged not to be a problem in the evaluation. 

B. GENERAL METHODOLOGY 

The design and implementation of each test was similar. 
Therefore, a description of the procedures used for Test 1 will 
be presented in detail. The specifics of each of the other tests 
are outlined in Table 2. 

Test 1 Objective : To determine the relative identification 

accuracy for agricultural crops achieved using eight types of ERTS 
and EREP imagery for one seasonal state (late summer) for one 
agricultural area (Northern Great Valley, California). 
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TABLE Z 


SUMMARY OF ERTS/EREP IMAGE INTERPRETATION TESTS 


TEST 

NUMBER 

TEST 

OBJECTIVE 

TEST AREA 

NUMBER OF PHOTO 
INTERPRETERS 

IMAGE TYPES 

TEST CATEGORIES/NUMBER 
OF TEST ITEMS PER CATEGORY 

TOTAL PI RESPONSES PER 
CATEGORY PER IMAGE TYPE 

1 

Agric ul tural Crop 
Identification 
(late summer 
seasonal state) 

Sacramento Valley, 
CA (Marysville and 
Sutter Sites) 

40 

ERTS Band 5 
ERTS Band 7 
ERTS Color Composite 
SKYLAB 1 9QA B/W (red) 
SKYLAB 190A B/W (IR) 
SKYLAB 190A Color 
SKYLAB 190 A Color IR 
SKYLAB 190A High Res. 

Color 

R (rice)/10 
0 (orchard)/10 
A (alfalfa)/10 
F (fal low)/10 
G (dryland pasture)/10 
X (other agric. craps)/10 

400 

400 

400 

400 

400 

400 

2 

Agricultural Crop 
Identification 
(late spring 
seasonal state) 

Sacramento Valley, 
CA (Marysville 
Site) 

10 

ERTS Band 5 
ERTS Band 7 
ERTS Color Composite 
SKYLAB 1 90A B/W (red) 
SKYLAB 1 90A B/W (IR) 
SKYLAB 190 A Color 
SKYLAB 190A Color IR 

— — — ■ ■ ■ • 

R (rice)/6 
0 (orchard)/7 
A (alfal fa )/6 
F (fallow)/3 
G (dryland pasture)/7 
X (other agric. crops)/3 

60 

70 

60 

30 

70 

30 

3 

Stratification of 
Rice-Growing Region 
(late spring 
seasonal state) 

Sacramento Valley* 
CA (Marysville 
Site) 1 

10 

ERTS Color Composite 
SKYLAB S190A Color IR 

Rice, non- rice; 2 outlined 
test areas for delineation - 
total area = 17 sq. mi. 

20 delineated test areas 

1 

Natural Vegetation ! 
Type Identification 
(summer 

seasonal state) 

i 

1 ! 

; j 

i 

Colorado Plateau 

40 

ERTS Band 5 
ERTS Band 7 
ERTS Color Composite 
SKYLAB 190A B/W (red) 
SKYLAB 190A B/W (IR) 
SKYLAB 190A Color 
SKYLAB 190A Color IR 
SKYLA8 190B High Res. 

Color 

J (pi nyon- juniper woodland)/! 0 
P (ponderosa pine forest)/10 
W (sedge (wet) meadow)/10 
A (aspen forest)/10 
S (spruce-fir forest)/10 
X (other vegetation types)/10 

i 

400 

400 

400 

400 

400 

400 

5 

Value of Stereo- 
scopic Viewing 
for Natural 
Vegetation Type 
Identification 
( summer 

seasonal state) 

Colorado Plateau 

10 

SKYLAB 190A Color IR 

J (pinyon-juniper woodl'and)/10 
P (ponderosa pine forest)/10 
W (sedge (wet) meadow)/10 
A (aspen forest)/10 
S (spruoe-fir forest)/10 
X (other vegetation types )/10 

100 

100 

TOO 

100 

100 

TOO 









Agricultural Crop Categories : 


R - rice 
0 - orchard 
A - alfalfa 
F - fallow 

G - dryland pasture (grass) 

X - other agricultural crops 

Image Types (positive prints, approximate scale = 1/150,000) : 


B/W: 1. ERTS MSS Band 5 

2. ERTS MSS Band 7 

3. SKYLAB 190A (red) 

4. SKYLAB 190A (infrared) 

COLOR: 5. ERTS Color Composite 

6 . SKYLAB 190A Color 

7. SKYLAB 1 90A Color Infrared 

8 . SKYLAB 190B Color (high resolution) 


Test Format (each test item marked b.y an annotated dot on an 
acetate image overt ay f : 

Training examples: 2 per test category per image type 

Test items: 10 per category per image type (=60 per image type) 

Time for interpretation: approximately 5 minutes per image 

type for training ; 30 seconds per test item (30 minutes per 
image type for the actual testi ng ) . 

Interpreter Assignments (using 40 students who currently were 
taking photo-interpretation courses at the University of California ; 
see Appendix Bf: 

Group I ( 20 ) Group II (20) 

Subdivided into sections A,B S C S D Subdivided into sections A,B>C,D 

Four sections of five interpreters each were chosen in such 

a way as to include in each section a range from high to low ability 

as determined from University course progress- 
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Interpretation Sequence (same image sequence and test procedure 
duplicated for Groups I and II ): 

The image sequence was rotated so that each image was 
interpreted in a different sequence by each section of five inter- 
preters, thus minimizing bias due to interpretation sequence. 

May 16, 1974 - Color Images (5-8) 


CO 

U- 

<D 

a> £? 

£ 

4- CL) O 
— ' +-> •*- 
d -40 
d *r- O 

O CD 

♦r— O co 
4 -> 4-5 
U C 5^ 
a r qj 



sequence 
1 2 

in 

3 

whi cl 
4 

i 

A 

5 

8 

7 

6 

B 

6 

1 

5 

8 

7 

C 

7 

6 

5 

8 

D 

8 

7 

6 

5 


May 23, 1974 - B/W Images (1-4) 


O 

CD 

to 


1 

sequence 

in 

which 


i 

2 

3 

4 

A 

i 

4 

3 

2 

B 

2 

1 

4 

3 

C 

3 

2 

1 

4 

D 

4 

3 

2 

1 


Photo Interpretation Responses (sample response sheet. Figure 16): 

(10 reponses/crop category) x (6 crop categories/image) x (8 images/PI) 

= 480 responses/PI 

Each test image was accompanied by a clear acetate overlay 
containing an annotated sequence of training and test items. With 
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Figure 16 : Sample interpretation test response sheet 


PI RESPONSE SHEET NAME: IMAGE: 

ERTS SKYLAB AGRICULTURAL PI TEST GROUP: SECTION: 


IMAGE H RESPONSE 

1 

2 

3 

• 4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14' 

15 

16 

17 

18 

19 _____ 

20 

21 

22 

23 

24 

25 

26 

27 

28 

29 

30 


IMAGE # RESPONSE 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 _____ 

47 

48 

49 

50 

51 

52 

53 

54 _____ 

55 

56 

57 

58 

59 

60 


KEY TO TEST RESPONSES : 

R - rice 
0 - orchard 
A - alfalfa 
F - fallow 
6 - dryland pasture 
X - other agricultural 
crops 
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the overlay positioned correctly, each labelled dot fell well 
within a uniform image area belonging to one of the test categories. 
The interpreters were asked to make judgments regarding the 
identity of the image area within the vicinity of each dot. 

Instructions were standardized so that each interpreter 
would proceed in the same manner during the entire testing period 
(Appendix B). During the training phase , interpreters were 
instructed to study the image characteristics of each category. 

Two examples of each category (which were judged to be representa- 
tive of that category within the test area) were provided for 
this purpose. The interpreters were asked to establish for them- 
selves the image attributes (color or tone, texture, pattern, 
shape, topographic position, etc.) which characterized each 
category. No interpretation key or other descriptive material 
was provided. Each interpreter, working independently, established 
his own criteria for identifying the test items. 



Figure 17. View of one of the interpreter groups 
at work in the EarthSat Berkeley classroom. 
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The testing phase (Figure 17) was accomplished using a uniform 
time interval of 30 seconds for each test item (30 minutes for each 
test image of 60 test items).- For a particular set (e.g., the 
eight image types comprising Test 1), the sequence of image types 
was rotated as previously described. The interpreters were asked to 
study each test item on a given image type, compare it to the 
training examples , and decide which of the categories it most closely 
resembled. The letter code of the category selected for that test 
item was then to be recorded on the response sheet (Figure 16). 

C. ADDITIONAL BACKGROUND PROVIDED TO INTERPRETERS FOR NATURAL VEGETATION 
TESTS 

The ecological knowledge and understanding of the photo interpreter 
is a strong determinant of both the accuracy and information content of 
his interpretations of natural vegetation ecosystems. In an operational 
context, each interpreter must know what to expect on the landscape 
being interpreted. This means that he must use prior field experience 
in the project area to understand the kinds of vegetation which occur, 
the interrelationship of the vegetation types one to another, and their 
relationship to the topographic and soil environment. To the extent 
that this knowledge grows, his interpretation ability increases. For an 
image comparison test, variable knowledge among interpreters regarding 

1/ The instructorTn charge also served as a ''timer" by orally stating 
(after 25 of the 30 seconds had elapsed for interpreting a given test 
item) "5 seconds left" and then by announcing the number of the next 
test item at the end of each 30 second period. The students used in 
these tests reacted favorably to this procedure. 
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the area and its ecology may introduce additional and undesirable 
variability into the test. Ideally, as a test of the imagery alone, 
it would be best if all interpreters were at the same knowledge level. 
Thus, the test results should reflect differences in image character- 
istics, not differences in interpreter ability. 

In this test, photo interpreters were used who, as a group, 
knew little about the plant ecology of the Colorado Plateau Test Area. 

A brief illustrated lecture on vegetation types and ecological zonation 
in the region of the Test Area was presented so that all interpreters 
would begin at the same level of understanding. The background 
material was presented without reference to the specific test area or 
to the ERTS or EREP image signatures of the various classes to be 
interpreted. The natural vegetation categories discussed are listed 
in Table 2. The lecture included presentation of the complete zonation 
of these categories from the saltdesert, shadscale types typical of 
the deeper, drier valleys through the sagebrush, juniper, ponderosa 
pine, and spruce-fir zones. Colored photographic illustrations (Figures 
5 through 10) showed a ground view of the vegetation types that typified 
each zone. A few low altitude aerial obliques (Figures 11 through 15) 
were shown to provide the interpreters with a better feeling for the 
zonation patterns and the ways in which vegetation from one zone inter- 
laces with that of another in the test region. All of the ground shots 
and aerial obliques were of analogous locations, not of specific test 
or training areas. Examples included all of the categories used in the 
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test as well as other typical vegetation found in the region but 
excluded from the test set. The presentation was concluded by 
showing the interpreters a distant* high oblique view across an 
analogous zonational pattern near the test area to give them a 
perspective of the physiographic relationships. 

In the above presentation, specific ERTS or Skylab image 
characteristics associated with each vegetation type were not 
mentioned. It was left entirely to the individual interpreters 
as they studied and analyzed the two training examples of each 
test category to develop the image-subject relationship criteria 
they would individually use in the interpretation tests. 
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IV. SUBJECTIVE TEST PROCEDURES 
A. NORTHERN GREAT VALLEY TEST AREA 

1 . Minimum Field Size and General Land Use 

Time available for formal interpretation testing was 
limited and certain questions did not lend themselves well 
to the formal testing procedure. A subjective analysis of 
the eight different image types was performed by experienced 
members of the project staff who judged the minimum field 
size consistently detected and the certainty with which land 
use categories could be identified on the test images. The 
subjective analysis was documented by preparing tables listing 
each of the various film/filter/system combinations and placing 
interpretation results in the appropriate columns. 

Agricultural fields of known sizes were studied on each 
image type and the minimum field size consistently identi- 
fiable was recorded as a range of values for both high and low 
contrast targets. In a separate analysis, tables were prepared 
listing various land use categories and the degree of certainty 
of detecting and identifying the various land use classes. 

One tabular display shows the certainty of identification for 
interpretation of single images. Another was prepared for 
results from viewing two images at a time, side-by-side, by 
visual comparison of each feature of interest. 
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2. Seasonal Aspects and Frequency of Coverage 

The seasonal aspects of agricultural interpretation were 
also considered, as well as the frequency of image coverage 
available. 

For the Northern Great Valley of California, sequential 
ERTS-1 coverage was available for the periods from mid-April 
through September. Using these images taken at 18 day inter- 
vals, certain judgements were made regarding the frequency of 
coverage desired from an observation satellite. A discussion 
of these findings is contained in Section VI A. 

3. Crop Vigor Evaluation and Plant Stress Detection 

Also included as a phase of qualitative testing was the 
assessments of the role of ERTS and EREP imagery for evaluating 
crop vigor and detecting plant stress. The investigators 
relied heavily upon the experience they have gained from 
on-going ERTS and SKY LAB experiments to draw conclusions 
regarding the utility of data from both satellite systems 
for vigor and stress assessment. 

4. Multi date Image Enhancement 

Interpreting multidate and multiband images is often a 
difficult process when done by purely manual means--that is, by 
visually viewing one image at a time and comparing its informa- 
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tion content with that of another image. Several methods of 
combining multiple images are in use that greatly simplify the 
display of these images. With these methods, certain unique 
colors or tonal values are assigned to particular features of 
interest. 

A limited number of image enhancements have been prepared 
for this study which take advantage of the unique color associated 
with a particular vegetation type when images of the same area 
from two dates have been combined by additive color projection. 

A variety of image combinations can be made, such as using 
various bands on various dates and even using both positive and 
negative images in producing additive color photos. Obviously, 
much unproductive effort can be applied to making various additive 
color images unless careful thought is given to the component 
photos used before starting. 

B. COLORADO PLATEAU TEST AREA 

Subjective analysis of the Colorado Plateau Test Area imagery 
focused on three major tasks: (1) assessing the relative utility of 
each of the image types for interpretation of natural vegetation 
categories; (2) ranking the image types according to their usefulness 
for vegetation mapping, and (3) evaluation of the effect of image 
quality on vegetation interpretation. These results were undertaken 
by experienced interpreters well -versed in the ecology of the 
Test Area and its land form/ vegetation relationships. 
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V. QUANTITATIVE TEST RESULTS AND ANALYSIS 
A. NORTHERN GREAT VALLEY TEST AREA 

1 . Test 1 - Crop Identification, Late Summer Seasonal State 

Interpretation results from each interpreter response sheet 
were scored and tabulated in matrix form to indicate the correct 
responses as well as the occurrence of omission and commission 
errors (Figure 18). For Test 1, a total of 60 responses occupy 
each such matrix (6 categories x 10 test items per category for 
each image type). Results from Tests 2 through 5 were also tabu- 
lated in a similar fashion. 

The tabulated data (correct responses) were subjected to a 
two-way analysis of variance. Tests of significance were per- 
formed for the main effects (image type and crop category) and 
interactions, and all were found to be very highly significant. 

Results of pairwise comparisons across the image type 
effects using Tukey‘s method are presented in Table 3. Each 
entry in this table represents the mean number of correct 
responses (maximum possible = 10) for each crop category from 
each image type, based on the 400 responses obtained collectively 
from the 40 students who took this test. 

For a given crop category (e.g., within a column on 
Table 3), the starred entries fall within a confidence interval 
of +_ 0.5 response and are significantly different from the other 
image types. All other entries in that column fall outside this 
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PI Calls 


AGRICULTURE TEST RESULTS 


Name Menashe 
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Figure 18 . Sample response matrix for Test 1. Correct responses 
appear in the outlined diagonal boxes. This interpreter achieved 
71.7% correct (43/60) for the Skylab 190A CIR image. He made 
very accurate responses for 3 categories (rice, fallow, and 
dryland pasture) and was less accurate in his interpretation of 
orchard, alfalfa, and other agricultural crops. 




IMAGE TYPE 


TABLE 3 


ANALYSIS OF TEST 1 DATA 
(CROP IDENTIFICATION TEST, 
LATE SUMMER SEASONAL STATE) 
BY MEANS OF TU KEY'S METHOD OF 
PAIRWISE COMPARISON 


Entries in the table below are mean number of correct responses per 
interpreter. Starred entries within a column fall within a confidence 
interval of +^0.5 response and form an image class which is signifi- 
cantly different from the unstarred entries, and are therefore best 
for the interpretation of the crop category which heads that column. 
The far right column contains the average for all categories. Note 
that the ERTS color composite and EREP 190A Color IR images are 
significantly different from the other image types and, therefore, 
better for overall interpretive purposes. If no interpretation errors 
had been made by any of the 40 students, all entries in this table 
would contain the figure "10.0." 


CROP CATEGORY 



Rice 

Orchard 

Alfalfa 

Fallow 

Dryland 

Pasture 

Other 

Agric. 

Average 

for 

All 

Catagories 

- 

ERTS-5 

4.7 

4.5 

5.8 

5.1 

*9.2 

3.8 

5.5 

ERTS-7 

6.9 

7.4 

*7.8 

3.8 

7.0 

5.6 

6.4 

ERTS Color Composite 

7.1 

*7.9 

5.4 

*8.1 

*9.4 

*6.8 

*7.4 

EREP 190A B/W Red 

5.9 

4.8 

4.6 

6.8 

8.7 

5.5 

6.0 

EREP 1 90A B/W IR 

7,4 

6.5 

*7.7 

4.3 

7.4 

6.4 

6.6 

EREP 190A Color 

*8.3 

7.1 

4.6 

6.2 

*9.0 

5.1 

6.7 

EREP 190A Color IR 

7.3 

*8.0 

5.8 

*7.8 

*8.9 

*7.2 

*7.5 

EREP 1 90B Color 

7.6 

7.3 

‘ 4.8 

6.8 | 

8.6 

5.8 

6.8 
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interval. Within the orchard category, for example, the ERTS 
color composite and EREP S190A color infrared image form an 
image set which is significantly different from the others and 
best for identifying orchard crops. 

Overall identification accuracy is also presented in 
Table 3 for Test 1. Overall results for the ERTS color composite 
and Skylab S190A images are significantly different from the 
other image types, but there is no difference between them. The 
set of eight image types is ranked in the following manner with 
no statistical significance assigned to the ranking (extracted 
from Table 3): 


Image Type 

EREP S190A Color IR 
ERTS Color Composite 
EREP S190B Color 
EREP S190A Color 
EREP S190A B/W IR 
ERTS Band 7 
EREP S190A B/W Red 
ERTS Band 5 


1/ Maximum possible = 10 


Overall Average 
Correct Responses . , 
(all crop categories)— 

7.5 

7.4 

6.8 

6.7 

6.6 

6.4 

6.0 

5.5 


Commission errors were also analyzed using a two-way 
analysis of variance. Tests of significance were performed for 
the main effects (image type and crop category) and interactions, 
and all were found to be very highly significant. Pairwise compari- 
sons were made using Tukey's method. The image type(s) which 
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formed a group that was significantly different from the 
others ( lowest commission error) are listed in Table 4. 

From a standpoint of commission error, Table 4 suggests 
that the ERTS color composite might be favored over the EREP 
S190A color IR image. This conclusion is indicated because 
the ERTS color composite appears four times in Table 4, while 
the S190A color IR image appears only twice. 

2. Test 2 - Crop Identification, Late Spring Seasonal State 

The objectives and format of Test 2 were parallel to Test 1 
with the following exceptions: 

1) Imagery for the late spring seasonal state was 
used instead of late summer seasonal state. 

2) Skylab EREP S190B color imagery was not acquired 
at this date and therefore not tested. 

3) The Sutter Test Site was not imaged by Skylab 

at this date, and the number of test items common 
to both tests (in the Marysville Test Site) was 
therefore reduced from 60 to 32. 

4) Only 10 students were used for this test. 

Test responses were normalized and the results expressed on a 
basis of 10 test items per category. In this way, results of 
this test can be compared with Test 1. 

The tabulated data were subjected to a two-way analysis of 
variance. Tests of significance were performed for the main 
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TABLE 4 


ANALYSIS OF TEST 1 DATA 
(CROP IDENTIFICATION TEST) 

RANKING BY IMAGE TYPES BY COMMISSION ERROR 


For each of the crop categories listed below, the image type(s) 
are given which form a group that is significantly different from all 
others in terms of commission error (using Tukey's method of pairwise 
comparison). These image types are those for which commission errors 
are lowest. 


Crop Category 
Rice 

Orchard 

Alfalfa 

Fallow 

Dryland Pasture 

Other Agricultural Crops 


Image Type 

ERTS Band 7 
EREP S190A B/W IR 

ERTS Color Composite 
EREP S190A Color IR 

EREP S190A Color 
ERTS Band 5 
EREP S190A B/W IR 

ERTS Color Composite 

ERTS Color Composite 

ERTS Color Composite 
EREP S190A Color IR 
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effects (image type and crop category) and interactions, and 
all were found to be very highly significant. 

Results of pairwise comparisons across the image type 
effects using Tukey's method are tabulated in Table 5. Each 
entry in this table represents the mean number of correct 
responses (normalized to a maximum possible of 10) for each 
crop category from each image type. 

For a given crop category (e.g., within a column on 
Table 5), the starred entries fall within a confidence interval 
of + 3.2 responses and are significantly different from the other 
image types. All other entries in that column fall outside this 
interval . 

Overall identification accuracy is also presented in 
Table 5 for Test 2. Overall results for the EREP S190A color 
and EREP S190A color IR images are significantly different from 
the other image types, but there is no difference between them. 
The set of seven image types (EREP S190B color image not tested) 
is ranked in the following manner (extracted from Table 5): 

Overall Average 
Correct Responses 
(all crop categories 

7.1 

7.0 

6.1 
5.9 
5.8 
5.6 
5.4 

V Maximum possible = 10 



Image Type 

EREP S190A Color 

EREP S190A Color IR 

ERTS Color Composite 

ERTS Band 5 

EREP S190A B/W Red 

ERTS Band 7 

EREP S190A B/W IR 
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IMAGE TYPE 


TABLE 5 


ANALYSIS OF TEST 2 DATA 
(CROP IDENTIFICATION TEST, 
LATE SPRING SEASONAL STATE) 
BY MEANS OF TUKEY'S METHOD OF 
PAIRWISE COMPARISON 


Entries in the table below are mean number of correct responses per 
interpreter. Starred entries within a column fall within a confidence 
interval of + 3.z responses and form an image class which is significantly 

different from the unstarred entries, and are therefore best for the 
interpretation of the crop category which heads that column. The far 
right column contains the average for all categories. Note that the EREP 
S190A Color and Color IR images are significantly different from the other 
image types and, therefore, better for overall interpretive purposes. If 
no interpretation errors had been made by any of the 10 students, all 
entries in this table would contain the figure ''10.0." 



CROP CATEGORY 

Rice 

Orchard 

Alfalfa 

Fallow 

Dryland 

Pasture 

Other 
Agric . 

Average 

for 

All 

Catagories 

ERTS-5 

*7.3 

5.3 

*6.0 

*5.7 

*6.9 

*4.0 

5.9 

ERTS-7 

*10.0 

6.4 

*3.7 

4.0 

*7.9 

*1.7 

5.6 

ERTS Color Composite 

*10.0 

6.0 

*3.7 

*7.7 

*8.0 

*1.3 

i 

6.1 

EREP S190A B/W Red 

7.2 

*7.4 

*5.0 

*7.3 

5.1 

*2.7 

5.8 

EREP S190A B/W IR 

*9.5 

5.3 

*5.5 

3.0 

5.6 

*3.7 

5.4 

EREP S190A Color 

|*9.5 

*8.7 

*4.7 

*10.0 

*6.9 

*2.7 

*7.1 

EREP S190A Color IR 

ho.o 

*8.1 

*3.8 

*7.3 

*6.1 

*6.7 

*7.0 
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The relative interpretability of the various crop 
categories at the two seasonal states — late summer (Test 1) 
and late spring (Test 2) — is perhaps best determined by 
comparing the test results for the EREP S190A color IR image. 
This image ranked high in both tests and in both tests was 
contained in the group of two images that was significantly 
different from the other test images. Those results, extracted 
from Tables 3 and 5, are presented here (expressed as mean 
number of correct responses, maximum possible of 10 in each 
category) : 



Overall results for the two seasonal states are comparable 
(75% for Test 1, 70% for Test 2). EREP S190A Color IR images acquired 
in late summer are better for identifying alfalfa and dryland pasture, 
while rice can be identified with 100% accuracy on late spring 
images, a marked improvement over the late summer date. These results 
indicate that (a) neither date would be preferred for overall 
identification accuracy, and (b) for identification of certain cate- 
gories, such as rice, alfalfa and dryland pasture, the choice of 
image type should be specified. 
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The overall results obtained for all image types at each 
of the two dates are as follows (from Tables 3 and 5): 

Overall Results 
Correct Responses 

Image Type (all crop categories )- !/ 

Late Summer Late Spring 


EREP S190A Color IR 7.5 7.0 

ERTS Color Composite 7.4 6.1 

EREP S190B Color 6.8 

EREP S190A Color 6.7 7.1 

EREP S190A B/W IR 6.6 5.4 

ERTS Band 7 6.4 5.6 

EREP S190A B/W Red 6.0 5.8 

ERTS Band 5 5.5 5.9 


1/ Maximum possible = 10 

In all but two cases (EREP S190A Color and ERTS Band 5), 
the late summer date is slightly better than the late spring 
date. However, the magnitude of the differences is not great 
enough to suggest a strong preference for either date. 

3. Test 3 - Stratification of Rice-Growing Regions 

The utility of one ERTS and one EREP image for stratifica- 
tion of a portion of the rice-growing region in the Northern 
Great Valley Test Area was determined. A 17 square mile area 
outlined on the ERTS color composite (May 28, 1973) and EREP 
S190A Color IR images (June 3, 1973) was interpreted by each of 
10 interpreters. At this early season date, most rice fields 
have been flooded and seeded and their identification is 
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facilitated. Each interpreted overlay was compared to a 
ground data map. Dot grids were used to determine the area 
mapped correctly, as well as the non-rice areas incorrectly 
mapped as rice (commission error). The results of this 
interpretation are summarized in Table 6. All results are 
expressed as area in square miles and percentage of the actual 
rice area (6.75 square miles). Results for both image types 
are very good, with slightly better results derived from the 
ERTS color composite than from the EREP S190A Color IR. These 
results are reasonable in light of the conclusions of Test 1, 
i.e., that these two image types are not significantly different 
for crop identification purposes under the conditions of the 
study. 

B. COLORADO PLATEAU TEST AREA 

1 . Test 4 - Natural Vegetation Identification, Summer Seasonal 
State 

In a manner similar to Test 1, the test data (correct 
responses) from Test 4 were tabulated in matrix form (Figure 18) 
and subjected to two-way analysis of variance. Tests of signi- 
ficance were performed for the main effects (image type and 
natural vegetation category) and interactions, and all were 
found to be very highly significant. 

Results of pairwise comparisons across the image type 
effects using Tukey's method are tabulated in Table 7. As in 
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TABLE 6 


INTERPRETATION RESULTS FROM TEST 3 
DELINEATION OF RICE-GROWING AREAS 
(LATE SPRING SEASONAL STATE) 



ERTS Color 
Composite 


EREP S190A 
Color IR 



Area 

(Sq. Miles)—' 

Percent 

Area 1 , 
(Sq. Miles)- 

Percent 

Actual Rice Area 
(from ground data) 

6.75 

100 

6.75 

100 

Correct Identification 

6.12 

90.7 

5.54 

82.1 

Commission Error 

0.20 

3.0 

0.52 

7.7 


y Mean values for ten interpreters 
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IMAGE TYPE 


TABLE 7 


ANALYSIS OF TEST 4 DATA 
{NATURAL VEGETATION IDENTIFICATION TEST) 

BY MEANS OF TUKEY'S METHOD OF PAIRWISE COMPARISON 


Entries in the table below are mean number of correct responses per 
interpreter. Starred entries within a column fall within a confidence 
interval of + 0.6 response and form an image class which is signifi- 
cantly different from the unstarred entries, and are therefore best 
for the interpretation of the natural vegetation category which heads 
that column. The far right column contains the average for all natural 
vegetation categories. Note that the EREP S190A Color IR image is 
significantly different from all other image types and therefore better 
for overall interpretive purposes. If no interpretation errors had 
been made by any of the 40 students, all entries in this table would 
contain the figure "10.0." 



NATURAL VEGETATION CATEGORY 

Pinyon- 

Juniper 

Ponderosa 

Pine 

Sedge 

Meadow 

Aspen 

Spruce- 

Fir 

Other 

Natural 

Vegetation 

Average 
for all 
Categories 

ERTS-5 

6.2 

6.4 

2.7 

4.0 

5.5 

2.8 



4.6 

ERTS-7 

8.4 

7.3 

*5.7 

6.8 

7.9 

1.3 

6.2 

ERTS Color Composite 

*8.5 

7.7 

5.0 

*8.8 

8.4 

3.8 

7.0 

EREP 190A B/W Red 

7.2 

6.9 

2.9 

4.9 

5.8 

3.5 

5.2 

EREP 1 90A B/W IR 

*8.6 

7.0 

*5.5 

8.2 

7.8 

1.2 

6.4 

EREP 1 90A Color 

7.8 

7.3 

3.3 

4.5 

5.7 

4.6 

5.5 

EREP 190A Color IR 

*9.1 

*9.2 

! *5.6 

*9.3 

*9.1 

*5.0 

*7.9 

EREP 190B Color 

*9.1 

6.4 

4.1 

5.3 

8.1 

*5.6 

6.4 
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Tables 3 and 5, each entry represents the average number of 
correct responses (maximum possible = 10) for each natural 
vegetation category for each image type. 

The EREP S190A Color IR image type was judged to be 
significantly different from (and better than) the other image 
types for identifying natural vegetation types. The spectral 
information of this image contributes largely to this result. 
Overall identification accuracy is also presented in Table 7 
for Test 4. For this test, the set of eight image types is 
ranked in the following manner: 


Image Type 

EREP S190A Color IR 
ERTS Color Composite 
EREP S190B Color 
EREP S190A B/W IR 
ERTS Band 7 
EREP S190A Color 
EREP S190A B/W Red 
ERTS Band 5 


1 J Maximum possible = 10 


Overall Average 
Correct Responses 
(All crop categories)! ^ 

7.9 

7.0 

6.4 

6.4 

6.2 

5.5 
5.2 

4.6 


Commission errors were also analyzed using a two-way analysis of 
variance. Tests of significance were performed for the main effects 
(image type and natural vegetation category) and interactions, and 
all were found to be very highly significant. Pairwise comparisons 
were made using Tukey's method. The image type(s) which formed a 
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group that was significantly different from the others 
( lowest commission error) are listed in Table 8. 

The EREP S190A Color IR image appears for all but one 
of the natural vegetation categories in Table 8 and is 
clearly the best image for lowest commission error. 

A threshold level of 2 commission errors per 10 items 
in a category was established to indicate a possible confusion 
level above which special training and care would be justified 
to minimize the occurrence of commission errors. The follow- 
ing summary was generated using this threshold: 


Correct Other types confused with category on 

Category only two or fewer of the test images 


Pinyon-juniper (0) A,S 

Ponderosa pine (P) 

Sedge (wet) meadow (W) J,P,A,S 

Aspen (A) 

Spruce-fir (S) J»P,W,S 


With this threshold, fewest commission errors occur with the 
sedge meadow and spruce-fir categories. Confusing ponderosa pine 
with sedge meadows was the most common commission error. The 
examples of sedge meadows used are all very small and inter- 
spersed with other vegetation types. 

The following ranking indicates those image types for which 
commission errors were largest: 
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TABLE 8 


ANALYSIS OF TEST 4 DATA 
(NATURAL VEGETATION IDENTIFICATION TEST) 
RANKING OF IMAGE TYPES 
BY COMMISSION ERROR 


For each of the natural vegetation categories listed below, the 
image type(s) are given which form a group that is significantly different 
from all others in terms of commission error (using Tukey's method of 


pairwise comparison). These images are 
are lowest. 

Natural Vegetation Category 

Pinyon- juniper 

Ponderosa pine 

Sedge meadow 

Aspen 

Spruce-fir 

Other natural vegetation 


those for which commission errors 


Image Type 

EREP S190A Color IR 

EREP S190A Color IR 

EREP S190B Color 

EREP S190A Color IR 
EREP S190A Color 
EREP S190A B/W IR 

EREP S190A Color IR 
EREP S190A B/W IR 
ERTS Color Composite 

EREP S190A Color IR 
EREP S190A B/W IR 
EREP S190B Color 
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Correct Image Types/Categories Having Largest Commission 

Category Error (decreasing error left to right) 


J 

P 

w 

A 

S 


ERTS-5/W 
S190A B/W IR/X 
ERTS-5/X 
S190A Color/S 
S190A Color/A 


S190A Color/W 
ERTS-7/X 

ERTS Color Comp/X 
S190A B/W Red/S 
ERTS- 5/A 


S190B Color/X 
ERTS-5/A 
S190A B/W Red/X 
ERTS- 5/ S 
S190B Color/A 


Commission errors are greatest for the various black-and-white 
image types {9 out of 15 entries). The natural vegetation categories 
having largest commission errors from this array are aspen (A), 
spruce-fir (S)> and other vegetation types (X). 

2. Test 5 - Natural Vegetation Identification - Stereoscopic vs . 
Monoscopic Viewing 

Test responses were tabulated for the 10 interpreters who 
completed both the monoscopic and stereoscopic interpretation of 
natural vegetation types using the EREP S190A color IR images 
(Table 9). The following overall percent correct results were recorded 
monoscopic interpretation: 82.7%; stereoscopic interpretation: 77.3%. 
The two sets of data were not significantly different when subjected 
to a paired t test (0.01 level of significance). Two reasons are 
offered to explain the fact that stereo results were not markedly 
higher than monoscopic results: (a) although the students had 
unimpaired stereo vision, none had spent extensive periods of time 
engaged in stereoscopic interpretation; (b) also, none of the students 
had experience in relating ecological relationships (such as were 
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PI CALLS PI CALLS 


TABLE 9 


RESULTS OF TEST 5: STEREOSCOPIC VS. MONOSCOPIC INTERPRETATION 

OF NATURAL VEGETATION TYPES USING THE EREP S190A COLOR IR IMAGE 


The matrices below contain the sums of the responses for the 10 
interpreters who completed this test. Entries in the heavily outlined 
boxes along the diagonal are correct responses. 

MONOSCOPIC INTERPRETATION (496 Correct/600 possible = 82.7%) 
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presented in the illustrated introduction to the natural vegetation 
tests) to stereoscopic models. 

To assess whether the results of a trained interpreter might 
be better than those of the student group, one of the investigators 
took the same test. This individual had extensive stereoscopic 
viewing experience and understood the relationships between 
vegetation and landform/elevation. His results are summarized 


bel ow: 


Number of 
Correct Responses 

(maximum = 10 ) 

Monoscopic Stereoscopic 


Pronounced improvement in identification accuracy was noted 
for all categories but one. This category — sedge meadow (W) — is of 
small image size and was sometimes difficult to see clearly on the 
stereo image pair. This stereo pair was printed at smaller scale 
than the monoscopic test image so that, when the pair was viewed 
stereoscopically with a pocket stereoscope, the scales of the two 
test sets would be approximately equal. This limited comparison 


highlights the important role to be played by a trained interpreter 
when extracting image information from a complex landscape. Knowledge 
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of the ecological relationships present in that landscape 
is essential to accurate interpretation. Under these circum- 
stances, stereoscopic interpretation will produce markedly 
improved results over monoscopic interpretation. 
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VI. SUBJECTIVE TEST RESULTS AND ANALYSIS 
A. NORTHERN GREAT VALLEY TEST AREA 

1. Minimum Field Size and General Land Use 

The relative merits of each image type for detecting and delineat- 
ing individual agricultural fields was assessed. It was recognized 
that the ease with which individual fields can be detected is 
a function of both the spatial and spectral resolution charac- 
teristics of the images. Fields of low or high tone or color 
contrast can be discriminated if the image has sufficiently 
high resolution. As resolution becomes poorer, fields which 
contrast sharply with their surroundings are still discernible. 

However, fields having low tone or color contrast in comparison 
to their surroundings are not easily detectable. 

These statements are substantiated by the subjective estimates 
of minimum detectable field size (Table 10). The order of these 
estimates also correlates well with the ranking of expected resolution 
(NASA estimates) for each image type (listed from poor to good): 

Minimum Field Size (Acres) 




(extracted 

from Table 10) 


NASA Estimate 




of Expected 

High 

Low 

Image Type 

Resolution (Ft.) 

Contrast 

Contrast 

S190A B/W IR 

223 

8-12 . 

30-40 

S190A Color IR 

187 

8-12 

12-17 

S190A B/W Red 

91 

3-5 

5-10 

S190A Color 

78 

3-5 

5-8 

S190B Color (high res.) 50 

3-5 

5-8 
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TABLE 10 


MINIMUM AGRICULTURAL FIELD SIZE (ACRES) 
CONSISTENTLY DETECTED ON EREP AND ERTS IMAGES 


Contrast 

EREP - Saotember 12, 1973 

ERTS MSS - September 13, 1973 

S 190 A 


B/W Red 

B/W IR Band 

Color 

Color IR 

Color 

Band 5 

Band 7 

Color 
Composite 
4, 5 & 7 

High 

3-5 

8-12 






10-15 

Low 

5-10 

1 

30-40 

5-8 

12-17 

— 

5-8 

30-40 

30-40 

20-30 
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In all cases, fields of high tone or color contrast can be 
discerned at smaller size limits than fields of low contrast. 
The nominal resolution of the last three images listed above 
permits substantially smaller fields to be discerned than does 
the resolution of the first two images. 

A similar case can be made for ERTS imagery. In this 
case, the spatial resolution of the three ERTS images used is 
theoretically fixed by the inherent pixel size. The process 
of generating the color composite image from 3 separate MSS 
bands might logically be thought to result in an image of even 
lower resolution than the black-and-white bands, 5 and 7. 
However, the improvement in color contrast afforded by a color 
image permits the detection of smaller (not larger) fields 
than is possible on the black-and-white images: 

Minimum Field Size (Acres) 
(Extracted from Table 10) 

ERTS Image Type High Contrast Low Contrast 

Band 5 10-20 30-40 

Band 7 10-20 30-40 

Color Composite (Bands 4, 5, 7) 10-15 20-30 

Especially for low contrast targets, this added spectral 

resolution of the color composite is valuable for detecting 

smaller fields. 
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In comparing EREP and ERTS data, one can draw comparable 
conclusions regarding minimum field size for the ERTS images as 
a group compared to the EREP S190A B/W IR image. Only this EREP 
image type was similar to the ERTS images, however. With all 
other EREP images, smaller fields could be detected as image 
resolution increased. Subtle improvements were observed between 
the S190A B/W red image and the S190A and S190B color images. 

The increased spectral discrimination of individual fields using 
a color image in comparison to a black-and-white image is 
suggested as the most significant reason, even though slight 
resolution differences also exist for these image types. 

Another question of interest in these subjective studies dealt 

with identifying and -del ineating land use in the Northern Great 
Valley Test Area. Using the same images as presented to the test 
subjects in this study, a series of land use categories was listed 
and the certainty with which positive identification and boundary 
delineations could be made by interpreting one image at a time 
was estimated by non-testing (subjective) analysis. The results 
of that effort appear in Table 11. The same type of analysis was 
made while comparing various combinations of EREP and ERTS images. 
The results of that effort are listed in Table 12. In each of 
these tables, subjective interpretation certainty is given by the 
following rating scale: 
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TABLE 11 


INTERPRETATION CERTAINTY FOR LAND USE IDENTIFICATION 
AND DELINEATION 

(Late Summer Seasonal State - Single Image) 




ETCEF^ 

September 12, 19/T - 

: i 



}, 1973 



S 




ERTS - September l 

LAND USE 
CATEGORY 

,B/W Red 

— 
B/W IR 

Color 

Color IR 

Color 

Band 5 

Band 7 

Color 

Composite 

Agriculture 

2 

2 

" 1 ‘ 
1 

2 

1 

3 

3 

2 

Dryland 

Pasture 

2 

3 

2 

3 

1 

3 

3 

2 

Woodlot 

4 

4 

3 

2 

2 

4 

4 

3 

Urban 

2 

4 

| 

1 

3 

1 

4 

4 

4 

Unused Land 

3 

| 

4 

2 

2 

1 

4 

4 

3 

Water Bodies 
& Drainage 

3 

i 

2 

2 

2 

2 

4 

2 ' 

1 

1 

Total 

16 

19 

11 

14 

8 

22 

20 ! 

15 

J 


KEY TO INTERPRETATION CERTAINTY: 


LAND USE CATEGORY LEGEND: 


1 = Certain 

2 = Probable 

3 = Possible 

4 = Uncertain 


Agriculture - cultivated land 
Pasture - natural grassland used for 
livestock grazing or watershed 
Urban - residential, commercial, industrial; 

small and large cities 
Unused Land - dumps, floodplains, wasteland 
Woodlot - farm tree lots, 20 acres or 
larger in size 

Water Bodies and Drainage - lakes, reser- 
voirs, ponds, rivers, streams 
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TABLE 12 


INTERPRETATION CERTAINTY FOR LAND USE IDENTIFICATION 
AND DELINEATION 

(Late Summer Seasonal State - Multiple Images) 



EREP S190A - September 12, 1973 

ERTS - 

September 13, 1973 

LAND USE 
CATEGORY 

B/w Rea 
& 

B/W IR 

B/W Red 
& 

Color 

B/W Red 
& 

Color IR 

r B/W IR 
& 

Color 

B/W IR 
& 

Color IR 

Color 

& 

Color IR 

Bands 
5 & 7 

5 & 
Color 
Composite 

7 & 
Color 
Composite 

Agriculture 

2 

1 

1 

1 

2 

1 

3 

2 

ri " ' 

2 

Dryland 

Pasture 

2 

2 

2 

2 

3 

2 

3 

2 

2 

Woodlot 

4 

3 

2 

3 

2 

2 

4 

3 

3 

Urban 

2 

1 

2 

1 

3 

1 

4 

4 

4 

Unused Land 

3 

2 

2 

2 

2 

2 

3 

3 

3 

Water Bodies 
& Drainage 

2 

2 

2 

2 

j 

i 

2 

2 

2 

1 

1 

Total 

15 

11 

11 

11 

14 

10 

19 

15 

15 


KEY TO INTERPRETATION CERTAINTY: 

1 = Certain 

2 = Probable 

3 = Possible 

4 = Uncertain 






1 = certain 

2 = probable 

3 = possible 

4 = uncertain 


The relative ranking of the 8 image types for single image inter- 
pretation was determined by summing the interpreation certainty for the 


various land use categories: 
Image Type 


Total Certainty Ranking- ^ 


EREP S190B Color 8 
EREP S190A Color 11 
EREP S190A Color IR 14 
ERTS Color Composite 15 
EREP S190A B/W Red 16 
EREP S190A B/W IR 19 
ERTS Band 7 20 
ERTS Band 5 22 


Although significant differences cannot be derived from this 
array, it does represent the concensus of the investi- 
gators regarding the interpretation of general land use categories, 
and suggests the magnitude of relative accuracy ratings. 

In general, interpretation of two images in concert results 
in slightly improved interpretation accuracy for some image pairs, 
and no improvement for others. Ratings of the pairs of black-and- 
white images improve when they are interpreted together. However, 
interpretation of a color or color IR image is not improved by 
the addition of information from a black-and-white image. 


—^6 = certain ranking for all 


categories. 
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2. Seasonal Aspects and Frequency of Coverage 

Parallel studies have been conducted for the rice crops on 
the Coastal Plain of Louisiana and the Northern Great Valley of 
California using EREP and ERTS data. For California, weather 
conditions during the 1973 rice growing season were favorable for 
satellite image coverage and an excellent series of ERTS coverages 
was acquired on the 18 day cycle. 

In Louisiana, on the other hand, weather conditions during 
1973 were unfavorable and a complete series of images was not 
acquired during the growing season from either ERTS or the Sk.ylab 
satellite. One usable ERTS image was acquired at the beginning 
of the season during planting of the rice crop and one was acquired 
at the end, after harvest. No coverage was obtained of the 
Louisiana test area during the 1973 rice growing season from 
Skylab. Such problems can be anticipated in those agricultural 
areas characterized by high atmospheric humidity and persistent 
daytime cloudiness. 

Because of certain critical rice crop events (planting, 
emergence, heading and harvest) the 18 day period for repeat 
cloud-free ERTS coverage is acceptable. However, if one or more 
of those sequential overflights is lost due to cloud cover, the 
time span between image dates during critical crop events becomes 
unacceptaDle, as it was in Louisiana during 1973. Weather records 
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of the Louisiana test area have not been analyzed to determine 
what frequency of overflights would have provided adequate 
coverage during the growing season. Obviously, the 18 day cycle 
was not satisfactory. 

Photographic image quality is an important factor which 
greatly impacted interpretability of land use categories on 
sequential ERTS imagery. The certainty with which each of several 
land use categories can be identified was determined for various 
ERTS and EREP images acquired throughout the 1973 growing season 
(Table 13). Band registration, color fidelity and print density 
are the three aspects that varied from one date to the next in 
this series of images. In addition, atmospheric effects such as 
haze and cloud cover influenced the interpretability of some of 
these images. 

It should be noted that the ERTS image of the highest quality 
in all factors - atmospheric clarity, color fidelity, band regis- 
tration and print density - was the September 13, 1973 color com- 
posite supplied to the investigators. This factor is reflected in 
Table 13 where it was possible to identify with certainty all 
land use classes except woodlots on that frame. Some other 
ERTS prints provided were of relatively poor quality, such as the 
July 21, 1973 ERTS color composite. Skylab reproductions were 
fully satisfactory for evaluation purposes. 
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TABLE 13 


MULTIDATE INTERPRETATION OF 
LAND USE IDENTIFICATION AND DELINEATION 


INTERPRETATION 

CERTAINTY 

IMAGE TYPE AND DATE (1973) 

ERTS CC 
April 22 

ERTS CC 
May 10 

ERTS CC 
May 28 

ERTS CC 
June 15 

ERTS CC 
July 3 

ERTS CC 
July 21 

ERTS CC 
Sept. 13 

EREP 
S190A 
Color 
June 3 

EREP 
S190A 
Color 
Sept. 12 

EREP 
S190B 
Color 
Sept. 12 

1 

— 

APW 

APW 

APW 

APW 

APW 

APW 

APW 

BU 

ftP 

AB 

AP 

UB 

2 

u 

UB 

u 

UB 

UB 

UB 


UW 

PUW 

WT 

3 

B 


B 





BT 

T 


4 

T 

T 

T 

T 

T 

T 

T 





LAND USE LEGEND KEY TO INTERPRETATION CERTAINTY 


1 

2 

3 

4 


Certai n 
Probable 
Possibl e 
Uncertain 


A - Agriculture 
P - Pasture 
T - Woodlot 


U - Unused Land 
B - Urban 
W - Water Bodies 


















It is not possible to make meaningful judgments regarding image 
interpretability for some features when print quality is variable. 

3. Crop Vigor Evaluation and Plant Stress Detection 

Of all images tested in this study, color infrared images 
provided the best means to detect differences in crop vigor and for 
detecting plant stress caused by drought, soil deficiencies, disease, 
etc. Color infrared images record the spectral energy reflectance 
differences that occur between vigorously growing plants and 
stressed or damaged plants. In the near infrared spectral region, 
healthy plants reflect relatively high amounts of energy while 
stressed (unhealthy, wilted) plants reflect relatively low amounts 
of energy. This factor, coupled with the fact that the near infrared 
region is not as seriously affected by atmospheric haze as the 
visible spectrum, makes color infrared sensing an ideal method for 
recording information on plant vigor and stress when used from 
space and high flying aircraft. 

A study of numerous ERTS color composite images (color IR 
simulations using bands 4, 5 and 7) acquired over a variety of 
vegetation scenes and several dates confirm that spectral reflectance 
differences in plant vigor and plants under stress from soil 
nutrient or moisture deficiencies can be distinguished visually 
from those plants that are healthy. An excellent example of this 
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situation was observed by comparing an ERTS color composite 
image (1256-16421) of Northern Texas taken on April 5, 1973 
with a color composite image (1616-16362) taken at about the 
same time (March 31) in 1974, when severe drought conditions were 
experienced. As seen in Figure 19, these two color prints display 
a significant difference in overall red coloration because of the 
influence of drought in the 1974 period. 

It is interesting to note that, in the Northern Texas drought 
region (Young County) where these photos were taken, the predicted 
1974 winter wheat crop yield was about half as great as the actual 
1973 winter wheat crop yield, in spite of an estimated 22% increase 
in wheat acreage planted for 1974 crops. In this case, the image 
differences correspond to significant differences in yield. Similar 
differences in plant vigor were visible on other ERTS color 
composites in the Northern Great Valley of California where stressed 
fields were observed as a result of soil nutrient and moisture 
deficiencies. 

The minimum field size in which plant vigor problems can be 
detected is determined by several factors, including surface area 
affected, severity of the problem and characteristics of surrounding 
plants and soils. Perhaps the most useful analysis that can be made 
at the ERTS resolution level involves comparing images of a scene 
taken over a period of time whereby changes in red coloration of 
selected regions are observed and correlated with known ground 
conditions (drought, disease, etc.) 
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April 5, 1973 March 31, 1974 

Figure 19 . ERTS prints of North Texas (Young County) wheat growing area affected by 
extended drought in 1974. Print on left was taken April 5, 1973. Note overall reddish 
color indicating presence of growing plants. Print on right was taken March 31, 1974. 
Note absence of reddish color due to drought except in isolated agricultural areas 
where some irrigation has taken place. On the transparencies from which these prints 
were made, it was possible to detect significantly lower levels of water in lakes and 
reservoirs on right-hand print taken during the drought period than on the left-hand 
print. The presence of the reddish color on the left print is even more apparent on 
the original transparencies than on these copy prints. 


As noted earlier in this report (Table 10) even for high 

contrast ground features the smallest field that can be detected 

on ERTS images is 10-15 acres. Most plant stress situations have 
low contrast image signature. This requires that such anomalies 
have an areal extent of at least 20-30 acres for consistent 
detectability. 

For EREP S190A color IR images, the minimum detectable field 
size is 12-17 acres for low contrast targets, and for EREP 
S190B high resolution color images, the size drops farther to the 
5-8 acre range for features of low contrast. 

It is recalled that for regional crop surveys a range of 

minimum field sizes detectable at the level of 20-30 acres seems 

reasonable, but for the data to be useful to the farm manager 
(who can take corrective action if notified of a condition in 
time) a minimum detectable stressed area size of 5-10 acres is 
much more desirable. The question of minimum field size depends 
largely, however, on the size of farms being managed as a unit, 
cost of various corrective measures versus associated benefits, 
and farm practices common to the region concerned. It has been 
noted from past experience with high resolution aerial photos that, 
even when detailed information on crop problems is available to 
the farmer from aerial photo interpretation, corrective actions 
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are often reluctantly taken because of the high costs involved. 

Only in some of the more progressive farm regions have the use 
of aerial photographs been exploited to any degree for operational 
crop management. 

For an ERTS-type system to provide a low contrast minimum 
field size detectable at the 5 acre level, a minimum size of 
perhaps 1 to 2 acres for high contrast fields should be set as a 
detectability range. From Table 10 it is apparent that such a 
change would require a spatial resolution improvement of 1/5 to 
1/10 or more over present levels. Whether such a change can be 
justified at present levels of costs, technology and data benefits 
is very questionable since many farms are presently not in a position 
to utilize such data even if it were available on a timely basis. 

The data dissemination problem (making current information available 
to farmers on a weekly if not semi-weekly basis) is extremely complex 
and therefore the question of improving resolution for farm use 
may not be the controlling factor. 

A limited assessment of the recognition of lodging on rice fields 
was undertaken. Portions of rice fields which are lodged (plants 
have been blown over by winds or other disturbance) are more difficult 
to harvest, and reduced yields of varying magnitudes result. For 
purposes of crop forecasting, lodging estimates are important inputs 
to the prediction of yield reduction at the appropriate stages of crop 
development. 
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A number of low altitude aerial oblique photographs were taken 
prior to (August 28, 1973) and coincident with (September 13, 1973) 
the ERTS and EREP overpasses of the Sutter and Marysville Test Sites. 

The proportion of individual fields containing lodging and the location 
of lodged areas within each field are easily seen on these photographs 
(Figures 20 and 21). The corresponding areas covered by these photo- 
graphs were studied on each of the EREP and ERTS positive transparency 
images as well as on color and color IR high altitude aircraft 
photographs (scale 1/120,000) acquired coincident with the ERTS and 
EREP overpasses. 

The detection of lodged rice areas is more dependant upon spatial 
than spectral resolution. Lodged areas were easily recognized on the 
high altitude aircraft color and color IR photographs. The light color 
of lodged areas contrasts well with the darker color of standing grain 
(see also Figure 21). The difference is as apparent with either 
film type. 

Many areas of lodging were clearly evident on the EREP S190B color 
image. The resolutuion of this system (NASA estimate - 50 feet) was 
sufficient to recognize the lodging pattern evident in the area of 
Figure 20, while the lodging in Figure 21 appeared only as a subtle 
color difference. Only large, sharply defined areas of lodging were 
discernible on the EREP S190A color image. Its resolution (NASA 
estimate = 78 feet) was judged to be markedly poorer than the EREP 
S190B color for lodging detection. It should be noted that an occasional 
large lodged area could be picked out on the ERTS color composite. 
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Figure 20. Example of lodged rice in the Sutter Test Site. 
(August 28, 1973). 




J p « t: : < n *■ 

w ° K > S/.. . ** y « <• o v + . . ' 

L * %-*•» > v /t ^ «.* ^ 


' - <r^ X* f * 


'? • • ’ - * < •- X , v , ^ t « 

• 


Figure 21 . Example of lodged rice in the Marysville Test Site 
(September 13, 1973). The light color of lodged rice contrasts 
more sharply with standing rice in the dark fields on the right 
which have not begun to dry and mature than with the standing 
rice in the light fields on the left which are already maturing. 
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but only with prior knowledge as to its location. 

The only possible feature that might be confused with lodging 
at this date is the pattern of early maturing rice. Patches of a field 
which ripen prematurely (due to early drying of parts of fields) 
resemble lodging in that they are also light in color. The overall 
incidence of early maturity of parts of fields is much less cownon 
than lodging of an entire field. Hence, this confounding factor is 
not judged to affect significantly the conclusions reached above. 
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4. Multidate Image Enhancement 

A limited number of multidate additive enhancements were 
prepared as part of the subjective analysis for crop identification 
to enhance the pattern of rice culture during 1972 and 1973. In 
particular* three categories of rice culture were distinguished: 

a) fields containing rice during both 1972 and 1973 

b) fields containing rice in 1972 and another crop in 
1973 

c) fields containing another crop in 1972 and rice in 
1973 

Information of this type has a variety of uses, including 
a) the study of crop rotation and fallowing practices (for 
individual fields and on a regional basis), and b) the assessment, 
on a regional basis, of the year-to-year variation in total 
acreage devoted to rice culture. 

Only ERTS imagery was used for enhancement of year-to-year 
changes because the Skylab imagery acquired fell entirely within 
the 1973 growing season. Nevertheless, enhanced images generated 
from ERTS data are suggestive of the type of product that can be 
created from any type of multi band satellite image. The I S 
Addcol (additive color viewer) was used to produce the examples 
described below. 

The enhancement procedure used is summarized as follows: 

Image Color Derived on Each Date 
Image Type/Date Filter Rice Other Agricultural Crops 

ERTS Band 5/ July 26, 1972 Red Dark Red 

ERTS Band 5/August 8, 1973 Blue Dark Blue 
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Examples of the enhancements produced by this setup appear 

in Figure 22 (Sutter and Marysville Test Sites). Within the 

rice-growing areas (characterized by large fields of rectangular 

shape) the color sequence on the enhanced images is as follows: 

1972 1973 Color on En- 

Crop Crop hanced Images 


Rice Rice 

Rice Other agricultural crop 

Other agricultural crop Rice 

Comparison of the enhanced images with maps of ground data 
document the above sequence. 

It must be stressed that the multidate or multiband enhance- 
ment process is successful only if'the input images contain inherent 
spectral or temporal differences. The enhancement procedure can 
facilitate or enhance the interpretation of multi band or multi date 
images that meet this criterion. In addition, the enhancement 
procedure must be implemented by persons knowledgeable in the 
objectives of each enhancement as well as the signatures of each 
category on the input image. In this way the effectiveness of the 
enhancement procedure can be maximized. 

B. COLORADO PLATEAU TEST AREA 

1 . Subjective Image Evaluation 

A subjective assessment of the relative discriminability of 
vegetation and related landform features on each of the image 
types was completed by two experienced interpreters. They rated 
the imagery types in the following order from best to poorest: 


Dark 

Blue 

Red 
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Marysville Test Site 



Sutter Test Site 

Figure 22 . Multi date additive color enhancements of the Marysville and 
Sutter Test Sites. Within the rice growing areas characterized by large 
fields of rectangular shape, the color codes have the following signifi- 
cance: dark : rice in 1972 and 1973; blue: rice in 1972, other agri- 
cultural crop in 1973; red: other agricultural crop in 1972, rice in 

1973. See text for further discussion. 
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EREP S190B Color 
EREP S190A Color IR 

EREP S190A Color ,, 

ERTS Color Composite (bands 5 and 7 only)- 7 
EREP S190A B/W Red]/ 

ERTS Band 5 
EREP S190A B/W IR 
ERTS Band 7 

1 / These imagery types are of equal rank for this comparison. 
Although the particular test print of the EREP S190A 

color image was not of high quality, the ranking of this image 
type above is based upon inspection of the positive transparency 
and therefore reflects more realistically the value of this film 
type when reproduced properly . 

In vegetation management, the location of water bodies is 
of great importance. Therefore, conclusions were also reached 
with respect to detection of surface water features. The contrast 
between water and all other features (except cloud shadows) is 
greatest on black-and-white infrared images. This spectral band 
is superior even to color IR for surface water detection. The 
detection of small water bodies and narrow or intermittent streams 
is more easily accomplished with higher resolution systems (such 
as EREP) than with ERTS-type systems. 

2. Vegetation Mapping 

A delineation test was not undertaken for natural vegetation 
mapping because of the recognized difficulty in judging the correct 
ness of delineated areas on several images. There would be little 
difficulty in judging whether pure types are correctly mapped. 
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However, vegetation mapping may be done correctly in several 
fashions in the Colorado Plateau where vegetation complexes 
(mixtures of pure vegetation types) occur. As long as 

(1) the delineation lines follow ecotones on the ground and 

(2) the components of each delineation are correctly and adequately 
defined, the delineation is correct. Hence, it was recognized that 
a comparison of delineated test images would be a difficult task. 

As an alternative, the diversity of distinct image signatures 
as interpreted in six, one-square-inch samples from each image 
type was evaluated. Identical large and essentially cloud-free 
areas were laid out on each of the test images. Within this area 
of approximately 21 square inches, the above samples were drawn. 

Two experienced interpreters examined and discussed each sample 
area together. They decided first on the number of image classes 
(areas of distinct signatures) that could be easily discerned and 
mapped within each one-square- inch area and then on the total 
number of classes that could be mapped after very intensive study . 

The average total number of classes discerned and the 
average number easily discerned gives a further indication of 
relationship between color and black-and-white images for mapping 
purpose . These totals are: 

Image Total Classes Classes Easily 

Type Discerned Discerned 

Color 40 33 

Black-and-White 29 22 
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The number of image classes that were discerned on each 
image type are summarized in Table 14. One must remember that 
this subjective test has not addressed the question of image 
identification where the advantage of color over black-and-white 
imagery is most important. The above results are also in line 
with the quantitative tests, but in this subjective test the 
black-and-white images would not have ranked nearly as close to 
color had identification of delineations been a part of the 
subjective evaluation. Many vegetation types could be delineated 
on black-and-white images but delineation areas known to be 
different looked much alike in black-and-white. It is reasonable 
to state that visual identification of vegetation categories from 
a single band of black-and-white imagery can rarely be justified 
in an operational program if color can possibly be made available. 

3. Image Quality 

In terms of the adequacy of print quality for visual inter- 
pretation, some of the black-and-white images had such high contrast 
that mapping of detail across the entire image would have been 
difficult without LogEtronic or other special printing. The 
EREP S190A B/W red image was worst among the black-and-white images 
in this regard. The lower elevation sagebrush (shrub-steppe) 
and salt desert (semidesert) areas are very highly reflective 
because of the large amount of bare soil common to these environ- 
ments. In the absence of special precautions, vegetation and 
landform details are frequently lost in processing this band for 
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TABLE 14 


ERTS-SKYLAB SUBJECTIVE COMPARISON 
OF IMAGE TYPES FOR DISCERNING AND MAPPING 
NATURAL VEGETATION TYPES 


NO. OF IMAGE CLASSES 


IMAGE TYPEl/ 

TOTAL DISCERNED 

EASILY DISCERNED 

EREP S190A Color IR 

50 

41 

EREP S190B Color 

40 

29 

EREP S190A B/W Red 

36 

24 

ERTS Color Composite 
{bands 5 and 7) 

31 

29 

ERTS Band 5 

30 

19 

EREP S190A B/W IR 

25 

19 

ERTS Band 7 

24 

21 


y 


EREP S190A Color not evaluated because color quality of 
test print was suboptimal. 



visual interpretation, even though good data were recorded by 
the sensor. The problem is most serious when a single scene 
includes the gradient from semi desert to forested vegetation 
types. This problem is encountered with red band data for both 
ERTS and Skylab. In the case of the working materials, the fall- 
off in the semidesert and shrub-steppe types was worse with the 
S190A working materials than with ERTS. 

This problem of uneven and extremely high reflectivity was 
not evident in the black-and-white IR prints for either the ERTS 
or Skylab system, but a higher percentage of vegetation-soil 
boundaries were non-contrasting (thus harder to distinguish) on 
both of these infrared images as compared to the red band. 
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VII. 


CONCLUSIONS 


A. VEGETATION COMPLEX IDENTIFICATION 
1 . Agricultural Crops 

Crop Identification - Late Summer Seasonal State 

For the identification of agricultural crops at the late 
summer seasonal state, the EREP S190A color IR and the ERTS 
color composite images were significantly different from (and 
better than) all the other image types. For the test area 
studied, the spectral differentiation afforded by the color 
infrared medium is more useful for crop type discrimination 
than is the sharper resolution of the EREP S190A and S190B color 
images. Since all agricultural fields selected as test and 
training examples were well above the minimum detectable field 
size, little added information regarding crop type was derived 
from sharper image detail . 

All four color images ranked higher than the black-and- 
white images for crop identification. Image ranking is summarized 
below (from Table 3): 


Image Type 

EREP S190A Color IR 
ERTS Color Composite 
EREP S190B Color 
EREP S190A Color 
EREP S190A B/W IR 
ERTS Band 7 
EREP S190A B/W Red 
ERTS Band 5 


]_/ Maximum possible = 10 


Overall Average 
Correct Responses , , 
(all crop categories)^ 

7.5 

7.4 
6.8 
6.7 

6.6 

6.4 

6.0 

5.5 
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Crop Identification - Late Spring Seasonal State 

The EREP S190A color and color IR images were significantly 
different from the other image types for crop identification at 
the late spring seasonal state. All three color images ranked 
higher than the black-and-white images. Image ranking is summar 
ized below (from Table 5): 


Image Type 


Overall Average 
Correct Responses 
(all crop categories 


EREP S190A Color 7.1 
EREP S190A Color IR 7.0 
ERTS Color Composite 6.1 
ERTS Band 5 5.9 
EREP S190A B/W Red 5.8 
ERTS Band 7 5.6 
EREP S190A B/W IR 5.4 


]_/ Maximum possible = 10 


Crop Identification - Seasonal Comparisons 

Overall interpretation results for both image dates were 
very similar; only for the identification of specific crops can 
one date be recormnended over another. 

In both cases, all the color images ranked higher as a 
group than the black-and-white images. For the late summer 
seasonal state, the EREP S190A color IR and ERTS color composite 
were better than the other types; for the late spring seasonal 
state, the EREP S190A color IR and color images were best. The 
numerical rankings of the remaining images were not significantly 
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different; hence, it is impractical to attempt to specify a 
composite ranking for interpretation at the two seasonal states. 

The utility of additive color enhancement techniques for 
displaying (1) the regional extent of and (2) changes in areas 
devoted to rice culture over a two year period was demonstrated 
with ERTS imagery. 

Land Use Identification and Delineation 

The combination of high resolution and spectral discrimina- 
tion afforded by the EREP color images results in the highest 
subjective estimate of accuracy for land use identification and 
delineation. Whereas crop identification per se is accomplished 
most accurately on color infrared (EREP) or color infrared simula- 
tions (ERTS), the identification of land use categories frequently 
depends upon the detection of image pattern or detail as well as 
a unique image signature (e.g., urban areas are characterized by 
regular street patterns, and dryland pasture has a unique texture 
and pattern). Ranking of image type according to total certainty 
ranking is as follows, best image appearing first (from Table 11): 


Image Type 

EREP S190B Color 
EREP S190A Color 
EREP SI 90 Color IR 
ERTS Color Composite 
EREP S190A B/W Red 
EREP S190A B/W IR 
ERTS Band 7 
ERTS Band 5 


Total Certainty Ranking^ 

8 

11 

14 

15 

16 

19 

20 
22 


T7 6 = Certain ranking for all categories 

90 




2. Natural Vegetation 

For identification of natural vegetation, the EREP S190A 
color infrared image was significantly different from (and 
better than) the other image types. The four color images 
tested ranked higher than the four black-and-white images. 
Image ranking is summarized below (from Table 7): 


Image Type 

EREP S190A Color IR 
ERTS Color Composite 
EREP S190B Color 
EREP S190A B/W IR 
ERTS Band 7 
EREP S190A Color 
EREP S190A B/W Red 
ERTS Band 5 


]J Maximum possible - 10 


Overall Average 
Correct Responses , . 
(all crop categories)— 

7.9 

7.0 

6.4 

6.4 

6.2 

5.5 
5.2 

4.6 


Results from interpretation by 10 students using monoscopic 
viewing (82.7% correct) and stereoscopic viewing (77.3% correct) 
of the EREP S190A color IR image were not significantly different 
(paired t test). Interpretation was undertaken by one of the 
investigators who was experienced at stereoscopic interpretation 
and understood the relationships of the vegetation types to land- 
forms and topography. The result of this interpretation was 
improved accuracy from stereo viewing (85% correct identification 
with stereo viewing, 60% without). Inexperience on the part of 
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students (both with stereo viewing and understanding of 
ecological relationships) caused their relatively poor results 
and enforces the point that trained interpreters can use stereo 
viewing to good advantage. 

3. Combined Ranking for Agricultural Crop and Natural Vegetation 
Identification 

All eight image types tested have been ranked according to 

the overall mean correct identification for Tests 1 and 4. The 

ranking of each image type was identical on both tests with one 

exception (from best to worst):— ^ 

EREP S190A Color IR 
ERTS Color Composite 
EREP S190B Color 
EREP S190A Color 
EREP S190A B/W IR 
ERTS Band 7 
EREP S190A Red 
ERTS Band 5 

These results indicate that, for the vegetation complexes 
interpreted, and for the relatively large areas occupied by each 
test item, the spectral information from a color infrared image 
or ERTS color infrared simulation is more valuable than increased 
resolution provided b.y EREP color (S190A and S190B) images. 


T7 The EREP S190A color image ranked lower in Test 4 (Natural Vegetation) 
than in Test 1 (Agricultural Crops). However, it was predicted (Sec- 
tion III-A) that the poor color quality of the test print ( only for 
the Colorado Plateau Test Area) might affect its interpretabili ty for 
natural vegetation types. Its composite ranking here is assigned on 
the basis of the agricultural crop test results only. 
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B. VEGETATION COMPLEX DELINEATION 


1 . Agricultural Crops 
Minimum Field Size 

Minimum field size consistently detectable is directly 
related to image resolution for targets of both high and low 
contrast (Table 10). The image types can be ranked as follows 
(no statistical significance associated with order): 


Image Type 

EREP S190B Color (high res.) 
EREP S190A Color 
EREP S190A B/W Red 
EREP S190A Color IR 
EREP S190A B/W IR 
ERTS Color Composite 
ERTS Band 5 
ERTS Band 7 


Minimum Field Size (Acres) 


High Contrast 

Low Contrast 

3-5 

5-8 

3-5 

5-8 

3-5 

5-10 

8-12 

12-17 

8-12 

30-40 

10-15 

20-30 

10-20 

30-40 

10-20 

30-40 


Rice Crop Delineation 

Both the ERTS color composite and EREP S190A color IR 
images produced highly accurate delineations of a rice-growing 
region (Table 6). Commission errors were also minimal, 
indicating that the early summer season is an appropriate time 
of year for separating rice-growing from non rice-growing areas. 
Using the ERTS color composite, 90.7% of the rice- growing area 
was correctly identified; the. accuracy obtained with the EREP 
S190A color IR image was 82.1%. 
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2. Natural Vegetation 

The number of discrete, mappable image areas within 

several sample areas was determined for each image type (except 

the EREP S190A color print which was of suboptimal quality and 

not evaluated) by two skilled interpreters. The ranking of the 

image types is as follows (from Table 14): 

EREP S190A Color IR 
EREP S190B Color 
EREP S190A B/W Red 
ERTS Color Composite 
ERTS Band 5 
EREP S190A B/W IR 
ERTS Band 7 

C. VEGETATION VIGOR AND CONDITION 
1 . Agricultural Crops 

Either of the systems tested, EREP or ERTS, has adequate 
spatial resolution for regional agricultural crop survey purposes. 
Such surveys usually do not require absolute identification of the 
crop type in every field throughout the region. In this regard, 
the value of ERTS for making year-to-year comparisons of regional 
drought patterns was clearly stated with an example from Young 
County, Texas. Distinct regional image signatures were displayed 
(Figure 19) for drought (1974) and normal (1973) conditions. 

For more detailed agricultural surveys, however, such as those 
used by farm managers, market analysts and tax assessment officials, 
ERTS data do not provide adequate image spatial resolution for 
such uses. 
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EREP S190A will provide adequate images for some manage- 
ment applications but usually not those requiring local decisions 
related to plant vigor and stress, such as weed and pest control 
or soil additives (nitrogen, minerals, etc.). 

EREP S190B, on the other hand, provides improved resolution 
over the other systems and, when used under favorable atmospheric 
conditions (clear skies - minimum haze), can be applied by farm 
managers to make on-site decisions regarding field practices, 
particularly for fields of five acres or larger in size . 

The high resolution afforded by a system such as the EREP 
S190B camera is essential for detection of such yield-reducing 
factors as lodging which have sharp, well-defined boundaries and 
contrast sharply with the surroundings. Lodging patterns could 
be frequently confirmed only on the EREP S190B color image. The 
high spatial resolution of this system is much more critical for 
lodging recognition than is the spectral detail of the particular 
film type used in it. 

Because color infrared images provided the most useful data 
in this study for crop identification, it is recommended that color 
infrared film be specified for systems such as the EREP S190B when 
used for crop monitoring applications. This recommendation is 
justified even though only color film from the S190B system was 
available for testing in this study. 
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The frequency of timing of coverage for regional crop 
surveys and farm management practices is difficult to specify 
precisely because of the uncertainty of the occurrence of 
certain critical environmental events which may alter an other- 
wise "normal" season. These factors include such events as 
drought, frost damage, excessive precipitation and wind storms. 

As noted earlier, some agricultural areas are more prone to 
unfavorable weather conditions for remote sensing coverage and 
thus may be difficult to cover with any inflexible schedule. 

One factor is certain, however, and that relates to the delay 
in receipt of images once they have been exposed. For regional 
surveys a delay of several weeks may be acceptable to the 
agricultural analyst. For the market analyst and the farm 
manager remote sensing images are a perishable item and a delay 
of more than a few days can render the images almost useless for 
making current management decisions because of the irreversability 
of some crop problems if action to counteract a faulty condition 
is not taken promptly. 

Experience with both ERTS and EREP by the investigators 
indicates that data from both systems were not available in time 
to be applicable to market analysis or farm management and only 
marginally useful for regional agricultural analysis . 
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2. Natural Vegetation 

The utility of the various ERTS and EREP images for 
assessment of vigor and condition of natural vegetation in 
the Colorado Plateau area was not addressed in this study. 

D. IMAGE QUALITY CONSIDERATIONS 

Photo quality of prints can significantly affect the interpreta- 
bility of many features, particularly where tonal contrasts and feature 
sizes are at or near the threshold of detectability. It is therefore 
important to produce photos for visual interpretation with great care 
and to insure that information is not lost in the photo reproduction 
phase to any significant degree. 

Multidate images can provide improved detectability of vegetation 
types by exploiting the differences in target reflectances as seasonal 
changes occur. However, the photo systems tested did not show any 
inter-system differences in usefulness for the problems studied related 
to the multidate approach although we only evaluated two dates of Skylab 
data and seven dates of ERTS imagery. 
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APPENDIX A 


TEST IMAGE EXAMPLES 
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LIST OF TEST IMAGES 


TEST(S) TEST AREA IMAGE TYPE 

1 Northern Great Valley ERTS Band 5 

(Marysville Test Site) ERTS Band 7 

ERTS Color Composite 
EREP S190A B/W Red 
EREP S190A B/W IR 
EREP S190A Color 
EPEP S190A Color IR 
EREP S190B Color 


1 Northern Great Valley 

(Sutter Test Site) 


ERTS Band 5 
ERTS Band 7 
ERTS Color Composite 
EREP S190A B/W Red 
EREP S190A B/W IR 
EREP S190A Color 
EPEP S190A Color IR 
EREP S190B Color 


2 


Northern Great Valley 
(Marysville Test Site) 


ERTS Band 5 
ERTS Band 7 
EREP S190A B/W Red 
EREP S190A B/W IR 
EREP S190A Color 


2 & 3 Northern Great Valley 

(Marysville Test Site) 


ERTS Color Composite 
EREP S190A Color IR 


4 


Colorado Plateau 


ERTS Band 5 
ERTS Band 7 
ERTS Color Composite 
EREP S190A B/W Red 
EREP S190A B/W IR 
EREP S190A Color 
EREP S190B Color 


4 & 5 
5 


Colorado Plateau 
Colorado Plateau 


EREP S190A Color IR 

EREP S190A Color IR 
(Stereo) 
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KEY TO TEST ITEMS 
AGRICULTURAL CROP TESTS 


TEST ITEM | TYPE 


1 0 

2 0 

3 R 

4 X 

5 X 

6 F 

7 G 

8 R 

9 R 

10 F 

11 R 

12 G 

13 F 

14 X 

15 X 

16 0 

17 F 

18 A 

19 X 

20 X 

21 F 

22 X 

23 F 

24 A 

25 A 

26 F 

27 A 

28 G 

29 G 

30 G 


KEY TO CROP TYPES: 


TEST ITEM # 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 
57' 

58 

59 

60 


TYPE 


R - rice 

0 - orchard 

A - alfalfa 

F - fallow 

G - dryland pasture 

X - other agricultural crops 


! 


! i 


' 100 


ooD>>>o>>x^xff5Q*n^73XO p no^^^>ooo(D“n 



KEY TO TEST ITEMS 


NATURAL VEGETATION TESTS 


TEST ITEM # TYPE . 


TEST ITEM # 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 


S 

W 

W 

P 

P 

A 

S 

S 

A 

S 

A 

P 

P 

W 

P 

w 

p 

J 

J 

J 

J 

J 

X 

w 

w 

w 

J 

A 

A 

S 


31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 


KEY TO NATURAL VEGETATION TYPES: 

J - pi nyon- juniper woodland 
P - ponderosa Dine forest 
W - sedge (wet) meadow 
A - aspen forest 
S - spruce-fir firest 
X - other vegetation types 


TYPE 

W 
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> 

NORTHERN GREAT 
Marysville 


VALLEY TEST AREA 
Test Site 


> 


ERTS Band 5 
September 13, 1973 

Test #1 


► 


> 


> 


» 


I 


i 





» 


i 
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NORTHERN GREAT VALLEY TEST AREA ERTS Band 7 

Marysville Test Site September 13, 1973 


> 


Test #1 


» 
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NORTHERN GREAT VALLEY TEST AREA 
Marysville Test Site 


ERTS Color Composite 
September 13, 1973 

Test #1 


EREP S190A B/W Red 
September 12, 1973 

Test #1 



NORTHERN GREAT VALLEY TEST AREA 
Marysville Test Site 
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NORTHERN GREAT VALLEY TEST AREA 
Marysville Test Site 


EREP S190A B/W IR 
September 12, 1973 

Test #1 


» 


> 


f 



i 
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» 


NORTHERN GREAT VALLEY TEST AREA 
Marysville Test Site 


> 


EREP S190A Color 
September 12, 1973 

Test #1 
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NORTHERN GREAT VALLEY TEST AREA 
Marysville Test Site 


EREP S190A Color IR 
September 12, 1973 

Test #1 
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NORTHERN GREAT VALLEY TEST AREA 
Marysville Test Site 


EREP S190B Color 
September 12, 1973 


I 


NORTHERN GREAT VALLEY TEST AREA 
Sutter Test Site 


ERTS Band 5 
September 13, 1973 

Test #1 



i 


i 


no 



» 

ERTS Band 7 
September 13, 1973 

Test #1 


NORTHERN GREAT VALLEY TEST AREA 
Sutter Test Site 


I 
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I 


NORTHERN GREAT VALLEY TEST AREA 
Sutter Test Site 


ERTS Color Composite 
September 13, 1973 

Test #1 


I 


NORTHERN GREAT VALLEY TEST AREA 
Sutter Test Site 


EREP S190A B/W Red 
September 12, 1973 

Test #1 


> 




I 


NORTHERN GREAT VALLEY TEST AREA 
Sutter Test Site 


EREP S190A B/W IR 
September 12, 1973 


I 


Test # 1 



> 


► 
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NORTHERN GREAT VALLEY TEST AREA 
Sutter Test Site 


EREP S190A Color 
September 12, 1973 

Test #1 
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> 


NORTHERN GREAT VALLEY TEST AREA 
Sutter Test Site 


► 


EREP S190A Color IR 
September 12, 1973 


Test #1 


NORTHERN GREAT VALLEY TEST AREA 
Sutter Test Site 


EREP S190B Color 
September 12, 1973 

Test #1 




» 


NORTHERN GREAT VALLEY TEST AREA 


Marysville Test Site 


I 


ERTS Band 5 
May 28, 1973 

Test #2 


I 
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NORTHERN GREAT VALLEY TEST AREA 
Marysville Test Site 


ERTS Band 7 
May 28, 1973 

Test n 


I 


\ 


I 



NORTHERN GREAT VALLEY TEST AREA 
Marysville Test Site 


EREP S190A B/W. Red 
June 3, 1973 




► 


Test #2 


► 



» 


NORTHERN GREAT VALLEY JEST AREA 
Marysville Test Site 


EREPS190A B/W IR 
June 3, 1973 

Test #2 


► 


I 



> 


> 


► 
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> 


NORTHERN GREAT VALLEY TEST AREA 
Marysville Test Site 


> 


EREP S190A Color 
June 3, 1973 

Test #2 
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NORTHERN GREAT VALLEY TEST AREA 
Marysville Test Site 


ERTS Color Composite 
May 28, 1973 

Tests #2 and #3 


> 


> 


> 



i 


► 
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NORTHERN GREAT VALLEY TEST AREA 
Marysville Test Site 


EREP S190A Color IR 
June 3, 1973 

Tests #2 and #3 


» 


COLORADO PLATEAU TEST AREA 


ERTS Band 5 
August 16, 1973 

Test #4 


► 


> 
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COLORADO PLATEAU TEST AREA 


ERTS Band 7 
August 16, 1973 

Test #4 


fc 

V 


k 

w 
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COLORADO PLATEAU TEST AREA 


ERTS.Color Composite 
August 16, 1973 


Test #4 
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COLORADO PLATEAU TEST AREA 


EREP S190A B/W Red 
August 3, 1973 

Test #4 


> 


i 
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COLORADO PLATEAU TEST AREA 


EREP S190A B/W IR 
August 3, 1973 

Test #4 


» 


> 



► 
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-- '« 


I 


COLORADO PLATEAU TEST AREA 


EREP S190A Color 
August 3, 1973 

Test #4 
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COLORADO PLATEAU TEST AREA 


EREP S190B Color • 
August 8, 1973 

Test #4 
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> 

EREP S190A Color IR 
August 3, 1973 

Tests #4 and #5 


COLORADO PLATEAU TEST AREA 

i 



COLORADO PLATEAU TEST AREA 


EREP S190A Color IR 
August 3, 1973 

Test #5 


> 


i 


> 



i 


► 


i 
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APPENDIX B 


INFORMATION AND PROCEDURES 
FOR PHOTO INTERPRETERS 
TAKING QUANTITATIVE TESTS 
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TESTING THE INTERPRETABILITY OF 
ERTS-1 AND SKYLAB (EREP) IMAGERY 

Tests Involving 40 students from the University of California: 

A. Relevant background information regarding the students used 
in this test is as follows: 

1. Each student used in the test was enrolled at the time in 
one or the other of the following two courses on the Berkeley 
campus of the University of California under the instruction 
of Professor Robert N. Colwell. 

a. Forestry 102— "Forest Photogrammetry and Photo 
Interpretation"— 4 units. 

b. Interdepartmental Course 186— "Remote Sensing of 
Natural Resources"— 5 units. 

2. Each of these courses was of 10 weeks duration and was in 
the seventh week of instruction when these tests were 
conducted. 

3. As of the time when these tests were administered, students 
in both classes had received essentially the same training 
in the interpretation of aerial and space photography, and 
all of them had done acceptably well both in midterm 
examinations and in other phases of the course work. 

B. The group of 40 students was divided into two groups, based on 
the time they were available for taking the tests. 
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C. For each of the two groups, 12 hours of testing time was used: 

Group I— from 1:30 to 4:30 p.m. on May 16, 17, 23, and 24 
Group II--from 7:00 to 10:00 p.m. on May 16, 17, 23, and 24 

D. Information sheets issued to the students on May 15 (when they 
applied for assignment to a test group) and at the start of 
the first test period appear in this appendix. One purpose of 
these written instructions was to ensure that all 40 students 
could be treated essentially as a single population for testing 
purposes as a result of having received uniform instructions. 

E. Advantages of dividing the, 40 students into two groups of 20 
were as follows: 

1. As will presently be seen, it was necessary to produce 
only 5 sets of prints and accompanying overlays from each 
ERTS-1 or SKYLAB (EREP) image example used in these tests. 
Otherwise 10 sets of each would have been required with a 
consequent substantial increase in both the cost and the 
time required to produce the test materials. 

2. The classroom at the EarthSat Berkeley office comfortably 
accommodates a maximum of 20 students. 

3. Potential problems with respect to the hours of availability 
of students for testing purposes were minimized since some 
could be available for afternoon work, but not at night, 
while for others the reverse was true. 

4. During the course of each three-hour testing period, it was 
far easier to monitor the performance of each student in a 
group of 20 than it would have been in a group of 40. 
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INFORMATION FOR THOSE WHO WILL BE TESTING THE INTERPRETAB ILITY 

OF ERTS AND SKYLAB IMAGERY 


Each student who is to participate in these tests must either work 
entirely with Group I or else entirely with Group II throughout all four 
of the 3-hour sessions as scheduled below: 

GROUP I will meet from 1:30 to 4:30 p.m. on Thursday and Friday of 
this week (May 16th and 17th) and also from 1:30 to 4:30 p.m. on Thursday 
and Friday of next week (May 23rd and 24th) . 

GROUP II will meet on those same four days but from 7:00 to 10:00 p.m. 

Rigid compliance with this schedule is essential because, for a student’s 
test results to be valid, he must participate in all 12 hours of work assigned 
to his Group and at the time when the Group is scheduled to meet . Those who 
cannot fulfill this requirement, including prompt arrival by the scheduled time 
at each of the 4 sessions, should not apply. 

At the conclusion of the fourth session each student will be paid $60.00 
for his 12 hours of work. Payment will be in the form of a check from Earth 
Satellite Corporation. 

The tests will be conducted in a classroom that is located on the top 
floor of the Great Western Bank Building, 2150 Shattuck Avenue, Berkeley 
(about 4 blocks from Mulford Hall). Selection of this meeting place has been 
dictated by the fact that the NASA contract for the conduct of these tests 
has been awarded, not to the University of California (as had once been presumed), 
but to the Berkeley Office of Earth Satellite Corporation, which is located at 
the foregoing Shattuck Avenue address. Upon entering the lobby on the ground 
floor of the Great Western Bank Building the student should ride the elevator 
to the top floor by pushing the elevator button labelled "PH” for Penthouse. 

A receptionist on the top floor will meet him and escort him to the classroom. 

The EarthSat Berkeley group, like the University of California Remote 
Sensing Group, has performed many NASA funded remote sensing projects in the 
past and the testing will be based on ERTS and SKYLAB imagery of two of EarthSat ’s 
test sites, viz. an Agricultural Test Site in the Sacramento Valley, and a 
Wildland Test Site in the Colorado Plateau region. 

All necessary instruction for this testing program will be given to the 
student during the 3-hour sessions. No advance preparation is necessary. 

However, for each of the 4 sessions the student should bring with him a pen 
or pencil and a lens-type stereoscope of the type that he has been using in 
class at the University. Although the image examples will not lend themselves 
to stereoscopic study, the magnification offered by such a stereoscope makes 
it ideal for use as a monocular viewing device for the study of some features 
of the ERTS and SKYLAB imagery. 
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A total of 40 students will be needed for this testing exercise (20 
for Group' 1 and 20 for Group II). A somewhat larger number of students 
have expressed a desire to participate. If more students apply than can be 
accommodated, the few who will need to be rejected will be those who received 
the lowest grades on the first midterm in the photo interpretation course in 
which they currently are enrolled at U.C. A list of the students accepted 
for Groups I and II, respectively, will be posted on the door of Room 131 
Mulford Hall by 1:00 p.m. , Wednesday, May 15th. 

In order to apply, simply fill out the attached form, tear it from 
the sheet, and leave it on the table in front of this room as you leave. 


STUDENT’S NAME: 

Could you make all 4 Group I sessions if 
selected for that Group? Yes _____ No 

Could you make all 4 Group II sessions if 
selected for that Group? Yes No 

If your answer to both of the above is "Yes," which Group do 
you prefer to be in? Group I Group II 
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TEST PROCEDURES FOR INTERPRETATION OF ERTS AND SKVLAB IMAGERY 


OBJECTIVE : 

This series of photo interpretation tests is designed to determine the 
relative utility of both ERTS and SKYLAB imagery for identifying a variety of 
wildland and agricultural features. For each image type tested, the student 
will examine a marked set of training items. Having become familiar with the 
image characteristics of each category, he will then classify the annotated 
test items according to the list of category choices provided. 

INSTRUCTIONS : 

Each test image is accompanied by an acetate overlay on which the 
following annotations appear: 

(a) Registration marks for use in orienting the overlay to the 
corresponding marks on the image, 

(b) Training examples (marked by letters ) of each of the same types 
of features as the student will eventually be asked to attempt 
to identify on the test image, and 

(c) Numbered test items (1 through 60) on which interpretation 
tests will be conducted. 

The tests will be administered by following these instructions: 

«v 

(a) Match up the registration marks, making sure that the 

acetate overlay is in proper registration with respect to 
the image. Annotated dots on the overlay mark the location 
of training and testing items. The overlay is taped to the 
image so that it can be lifted periodically in order to study 
certain parts of the image more carefully. 

{ b) Trai ning phase : Study the lettered training examples and 

learn the recognition features of each category. 

(c) Testing phase : Proceed to test item number "1." Study it, 

compare it with the training (letter) examples, and decide 
which of the lettered examples it most closely resembles. 

Then write this letter opposite the corresponding number on 
the test response sheet that has been provided. Only one 
letter should be specified as the' answer for each test item. 

If there is uncertainty as to which answer is correct, 
select that category which most closely resembles the training 
examples. Do not leave blanks. 
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(d) It is anticipated that 30 seconds will be adequate for each 
identification and recording of results as described in 
step (c). At the end of 25 seconds-, the instructor will state 
"5 seconds," and thus the student will be able to complete the 
necessary work with respect to that example. (If for any particular 
example the student feels that he could have used more time to 
advantage, he should place a check mark opposite that example 
with the prospect of returning to it briefly at the end of the 
test. ) 

This procedure will be followed for each of several image types during the test 
period. The sequence of images will be randomized so that no single image is 
always tested first, thus minimizing interpreter bias due to image sequence. 


LETTER CODE TO CATEGORY TYPES : 

Agricultural Crops: R - rice 

0 - orchard 

A - alfal fa 

F - fallow 

D - dryland pasture 

X - other agricultural crops 
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June 3, 1974 


Memorandum to students who have been selected to perform additional 
ERTS and SKYLAB photo interpretation tests. 

1. You are among those who have indicated that you would be 
available to perform such tests and have been selected to do so. 

2. These additional tests will require an estimated period of 
4 to 4-1/2 hours and are to be conducted in a single session on the 
evening of Thursday, June 6, 1974 beginning promptly at 7:00 p.m. 
The tests will be conducted in the same EarthSat classroom as was 
previously used at 2150 Shattuck Avenue in Berkeley. 


3. Payment will be a fixed sum of $20 per student and will be 
made by check on Thursday evening, immediately following completion 
of the tests. 

4. In order that we can be sure that you will be participating 
in these additional tests, we ask that you sign the note appearing 
at the bottom of this page and hand it in immediately. Otherwise we 
will find it necessary to arrange for someone else to take your place. 


I'll be there! 


Signed 
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Information for University of California Students Relative to the 
Additional ERTS and SKYLAB Photo Interpretation Tests 
to be Conducted on June 6, 1974 


The additional space photos that you will be asked to interpret 
today cover the same agricultural and wildland areas as you previously 
studied, and you will be asked to attempt to identify on them the same 
categories of vegetation and land use. However, there are these important 
differences in the photos themselves: 

1. The additional space photos of the agricultural area 
were taken at an earlier date in the same growing 
season (viz. May 28 and June 3 vs September 12 and 13, 

1973). Therefore it is probable that you will find some 
categories easier to interpret and others more difficult. 

In fact, our primary purpose in giving this additional 
test is to determine to what extent this is true. 

2. The additional space photos of the wildland area were 
taken on the same date as the previous ones, but in 
this case will be presented to you in the form of a 
stereoscopic pair rather than as single photos. Hence, 
the primary purpose in our giving you this additional 
test for the wildland area is to determine whether 
stereoscopy facilitates the interpretation of wildland 
features on space photography and, if so, to what extent. 

In order to ensure that these additional test results will be 
comparable to the previous ones, we are taking the following measures: 

1. Each of you should sit in the same seat as before so 
if any differences in lighting exist throughout the 
room, the comparability of your test results will not be 
affected by this factor. 

2. Since the stereo pair examples are mounted on stiff 
cardboard, you can hold the card in your hand if you like 
and thus place it in the same position with respect to 

the light source as you placed the previous photo examples, 
in order to achieve the most favorable lighting. 
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Not only are the same geographic areas covered in these 
additional photos, but the same training spots and test spots 
also have been marked, using the same symbols and annotated on 
the same kind of acetate overlay. You may find, however, that 
the numbering sequences for the individual test fields have been 
changed. This factor, together with the fact that 2 or 3 weeks 
have elapsed since your previous tests, should minimize the likeli- 
hood that your interpretation results today will be significantly 
affected by your earlier study of these 120 spots. 

Today's testing procedure will be the same as previously 
in that you should first study the two training areas for each 
category, make brief notes for your own use as to the identifying 
characteristics, and then proceed to the identification, in sequence, 
of the numbered test examples. 

Consistent with the procedure used in the previous tests, 
you will be allowed 30 seconds, if needed, to identify each 
example. 
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Delineations of Rice-Growing Areas 

The objective of this portion of the test is to ascertain the 
accuracy with which the rice-growing portions of marked areas can be 
identified and delineated. A clear acetate sheet with areas marked for 
delineation is provided. For each image assigned, proceed by following 
these steps: 

1. Study the training examples for rice (R) and the other crop 
categories. Determine the image characteristics which 
distinguish rice from other crops. 

2. With the criteria established in (1), stratify the test areas 
into rice-growing and non rice-growing regions. by drawing 
directly on the acetate sheet. Make sure that all lines close 
and that there are no gaps. 

3. Label each discrete area as either rice-growing (R) or non 
rice-growing (N). When you have finished, each delineated area 
contained within the bounds of the test area should be labeled 
either R or N. 
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